-- Logs begin at Tue 2022-04-12 07:26:54 UTC, end at Tue 2022-04-12 08:37:26 UTC. -- Apr 12 07:58:51.178178 dv-cinder-836944-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 12 07:58:51.186348 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 07:58:51 2022] *** Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: nodename: dv-cinder-836944-3-iscsi Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: machine: x86_64 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: clock source: unix Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: pcre jit disabled Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: detected number of CPU cores: 4 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: current working directory: / Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: detected binary path: /usr/bin/uwsgi-core Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: your processes number limit is 47680 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: your memory page size is 4096 bytes Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: detected max file descriptor number: 2048 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: lock engine: pthread robust mutexes Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: thunder lock: enabled Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 12 07:58:51.190228 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 07:58:51.235000 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: Python main interpreter initialized at 0x557f843ea9c0 Apr 12 07:58:51.235000 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: python threads support enabled Apr 12 07:58:51.235000 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: your server socket listen backlog is limited to 100 connections Apr 12 07:58:51.235000 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: your mercy for graceful operations on workers is 90 seconds Apr 12 07:58:51.235497 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 07:58:51.235616 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: *** Operational MODE: preforking *** Apr 12 07:58:51.235894 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: *** uWSGI is running in multiple interpreter mode *** Apr 12 07:58:51.235894 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: spawned uWSGI master process (pid: 80243) Apr 12 07:58:51.236100 dv-cinder-836944-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 12 07:58:51.239503 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: spawned uWSGI worker 1 (pid: 80256, cores: 1) Apr 12 07:58:51.239503 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: spawned uWSGI worker 2 (pid: 80257, cores: 1) Apr 12 07:58:51.239503 dv-cinder-836944-3-iscsi devstack@keystone.service[80243]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 07:58:57.000783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 07:58:57.000783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: from cryptography.utils import int_from_bytes Apr 12 07:58:57.001565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 07:58:57.001565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: from cryptography.utils import int_from_bytes Apr 12 07:58:57.004827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 07:58:57.004827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: from cryptography.utils import int_from_bytes Apr 12 07:58:57.005262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 07:58:57.005262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: from cryptography.utils import int_from_bytes Apr 12 07:58:57.052255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 07:58:57.052447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 07:58:57.052641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] command line args: [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 07:58:57.052915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 07:58:57.053094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ================================================================================ {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 07:58:57.053356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] admin_token = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.053602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] config_dir = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.053790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.053973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] config_source = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.054055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 07:58:57.054153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] debug = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.054236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 07:58:57.054352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.054617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] command line args: [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 07:58:57.054679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 07:58:57.054738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.054875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ================================================================================ {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 07:58:57.054958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] admin_token = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] config_dir = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.055853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] config_source = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_config_append = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] debug = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_dir = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_file = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.056959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_config_append = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_dir = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.057999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_file = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.058935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.059948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] publish_errors = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.060898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] standard_threads = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.061977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] publish_errors = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] use_journal = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] use_json = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.062990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] use_stderr = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] use_syslog = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] standard_threads = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.063823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.063943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.064061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.064172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.064282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.064392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.064503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.064621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] use_journal = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.064621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] use_json = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.064829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.064940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] use_stderr = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.065056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] use_syslog = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.065286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:58:57.065522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.065975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.066903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.067824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.068981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.069900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.070935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.071889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.072974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.073832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.074895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.075961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.076961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.077987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.078681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.079922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.080902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.081816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.082945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.083903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.084936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.085960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.086989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.087971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.external = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.088919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.password = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] auth.token = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.089990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.external = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.090935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.password = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] auth.token = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.091878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.092922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.093986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.094108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.094223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.094337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.094449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.095954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.096886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.097961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.098896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.099890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.100793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.101956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.102873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.103962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.104968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.105998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.106943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.107884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.108937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.109978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.110927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.111899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.112945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.113977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.114900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.115952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.116981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.117905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.118929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.119895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.120940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] role.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.121978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] role.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.122994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] role.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.123914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] role.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.124969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.125907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.126949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.127905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.128825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.129941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.130976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.131917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.132951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.133977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.connection = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.134902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.135950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.connection = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.136997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137571 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.137915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 07:58:57.138490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.138490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.139005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.139005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.139220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.139342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:58:57.139533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 07:58:57.168297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.168529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.168758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.169682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.169920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.170151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.177304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.178747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.206702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.206932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.208324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.208563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.261060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.261839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.310481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.310706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.311658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.311899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.394935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.395657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.418605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.418837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.418931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.419962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.420041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.420179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.431149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.431718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.444921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80257) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.445928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80256) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 07:58:57.463249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.463458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 07:58:57.463566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.463730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 07:58:57.463810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.463999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 07:58:57.464091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.464241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 07:58:57.464321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.464507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.464590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.464760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.464847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.465010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.465089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.465260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.476991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.477072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.477269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.485317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.485500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.488652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.488833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.489038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.489869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.490934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.491124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.491210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.491384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.491498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.491675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.519030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.519388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.520610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.520883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.521066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.521342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.526409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.526683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.526893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.526974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.527171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.527446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.534312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.534585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.534869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.535147 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.539191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.539497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.539765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.539845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.540045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.540931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.541113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.541193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.541424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.541687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.560381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.560653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.561189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.561461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.565831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.566616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.569496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.569787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.570349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.570640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.574802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.575710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.579955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.580849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.583631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.583926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.584207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.584485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.584565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.584754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.584835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.585026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.585119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.585344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.585631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.585908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.707634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.707931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.708123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.708210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.708421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.708531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.708687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.708948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.716834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.716934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.718521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.718606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.718789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.718872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.721869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.722054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.722155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.722335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.722574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.722786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.722868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.723065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.723149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.723393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.736932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.737204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.737322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.737476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.737599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.737754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.737879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.738980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.757409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.757682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.760687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.761001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.764039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.764377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.765637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.766048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.767424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.767719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.767882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.767997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.768160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.768447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.775628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.776053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.777179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.777666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.780421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.780705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.780903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.781035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.781189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.781272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.781481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.781755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.790492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.790774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.791048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.791128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.791335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.791636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.799680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80257) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.799953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80256) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 07:58:57.800230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.800935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.801864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.802913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.803032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.803160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.803293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80257) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.803436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.803728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80256) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 07:58:57.841983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f843ea9c0 pid: 80257 (default app) Apr 12 07:58:57.842434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f843ea9c0 pid: 80256 (default app) Apr 12 07:58:57.845983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0f15-81ff-4aa1-896d-1b2f21eb6c74 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:58:57.846276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0f15-81ff-4aa1-896d-1b2f21eb6c74 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:58:57.846550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0f15-81ff-4aa1-896d-1b2f21eb6c74 None None] PATH_INFO: `/v3` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:58:57.850742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue Apr 12 07:58:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:06.770303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:06.770871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:06.770871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:06.775458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:06.781024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:06.781435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:06.781581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:06.811792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG oslo_db.sqlalchemy.engines [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 07:59:06.999649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG passlib.handlers.bcrypt [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80257) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 07:59:07.000073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG passlib.handlers.bcrypt [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80257) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 07:59:07.065736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:07.067319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:07.187595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 12 07:59:07.321222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:07.356218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG oslo_db.sqlalchemy.engines [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 07:59:07.483818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee75b-9fe9-4485-a4ab-96a9edf4f779 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:07.488038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:07.488799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:07.489083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:07.489361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:07.497364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:07.548426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 07:59:07.548763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632c4e0-b9c1-44d0-8480-fb4968689595 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:07.557817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Apr 12 07:59:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 07:59:07.565020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:07.579134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ade9d-0239-43da-8e31-01a2c26bbbcb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:07.584016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:07.585146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:07.585435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:07.585712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] PATH_INFO: `/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:07.587225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] RBAC: Authorizing `identity:get_project(project_id=70f2e3c61bc141f3b38a097da3fa11ff)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:07.640377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.common.rbac_enforcer.enforcer [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 07:59:07.640729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1b17-9854-4f7a-a600-e6afbe5f1025 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:07.645883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue Apr 12 07:59:07 2022] GET /identity/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:09.905522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d0d7-4caf-43c2-964d-d2df04c97aeb None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:09.906059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d0d7-4caf-43c2-964d-d2df04c97aeb None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:09.906152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d0d7-4caf-43c2-964d-d2df04c97aeb None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:09.910755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:09.916070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:09.916491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:09.916618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:09.935219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:09.936767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:09.944478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 12 07:59:09.966202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d0d7-4caf-43c2-964d-d2df04c97aeb None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:09.978526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d0d7-4caf-43c2-964d-d2df04c97aeb None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:09.982754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:09.983378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:09.983694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:09.983977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:09.992122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:09.993926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b1303-5752-4aa3-86ab-912f18e7db9d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:10.004008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Apr 12 07:59:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 07:59:10.011600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:10.020556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea7378-6632-454c-ac2e-6cae20045014 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:10.025158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:10.026021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:10.026302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:10.026574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:10.028001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:10.029822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9055-2cc4-46ce-9e25-1c89cd725660 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:10.031372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue Apr 12 07:59:10 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:12.366429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c0e-6015-46e7-87c0-e33a4db29ed5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.366958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c0e-6015-46e7-87c0-e33a4db29ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.367052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c0e-6015-46e7-87c0-e33a4db29ed5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.368449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:12.373540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.373965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.374102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.383945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f1ac-1299-4cc4-af49-ea0fc6e786ee None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.384236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f1ac-1299-4cc4-af49-ea0fc6e786ee None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.384519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f1ac-1299-4cc4-af49-ea0fc6e786ee None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.385844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:12.390757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.391042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.391210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:12.391310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.392431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:12.431249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG passlib.handlers.bcrypt [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80256) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 07:59:12.431644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG passlib.handlers.bcrypt [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80256) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 07:59:12.469254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:12.478463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:12.480078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:12.493800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.575440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:12.588470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa20c-6e24-4a4e-b0ee-b5d9de15421e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:12.596685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.621746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:12.622547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.622836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.623116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.634430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:12.641524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:12.642725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:12.648484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.693089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28ff0-383e-4231-aa4a-d230a7534ad0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:12.724196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:12.725014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.725299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.725573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.740797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a592f0-7cfa-49c4-a963-56ffb79b3cd0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:12.772056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:12.772709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.772997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.773276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.774028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:12.774335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:12.776032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:12.787287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:12.788353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:12.789898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:12.792744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.882777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 07:59:12.890023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.891851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9579ab3-5007-4f30-94dd-89af59715f3e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:12.923968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:12.924834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:12.925658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:12.925931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:12.927164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:12.928673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:12.930270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:12.935450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:12.982764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718bb3-d8a4-4b39-b4f2-cdddfb9ab870 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:13.014356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:13.015150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:13.015429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:13.015889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:13.026243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef57a-a53a-4d14-a8c0-e7f590e587b4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:13.033866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:13.035892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:13.052800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 07:59:13.053991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:13.058726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:13.058986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:13.059263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:13.059566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:13.059695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:13.060751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:13.062224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:13.063820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:13.069315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:13.152847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953612a4-f16f-48dc-aa26-36cbe81223a0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:13.161061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da3639-34ae-41aa-b50d-96874fbc1582 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:13.188464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:13.189134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:13.189417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:13.189693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:13.190417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:13.190778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:13.192187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ba87-deaa-4c72-96d5-517dbd09d0d4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:13.195355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:13.196042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:13.196328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:13.196605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:13.197432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.domain.id=default, user.id=6096b896d07e4c27995c80c998efa491) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:13.197745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:13.199171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3437f3-4b04-4583-ade0-79d0ba953fe7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:13.205731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Apr 12 07:59:13 2022] GET /identity/v3/role_assignments?user.id=6096b896d07e4c27995c80c998efa491&scope.domain.id=default&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:13.209504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:15.735147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315023-2fc9-43a6-8a38-15f64fd11533 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:15.736195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315023-2fc9-43a6-8a38-15f64fd11533 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:15.736701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315023-2fc9-43a6-8a38-15f64fd11533 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:15.739110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:15.744211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3412-6656-444c-8be4-0f975e9f379c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:15.744981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3412-6656-444c-8be4-0f975e9f379c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:15.745464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3412-6656-444c-8be4-0f975e9f379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:15.763064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-bc0e3412-6656-444c-8be4-0f975e9f379c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:15.764628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bc0e3412-6656-444c-8be4-0f975e9f379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:15.844524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:15.879749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e315023-2fc9-43a6-8a38-15f64fd11533 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:15.994078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3250-8b7c-456a-99a2-405573e05a0c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:15.994704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3250-8b7c-456a-99a2-405573e05a0c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:15.995185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3250-8b7c-456a-99a2-405573e05a0c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:15.996768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:16.001957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.002544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.003632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.017967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e315023-2fc9-43a6-8a38-15f64fd11533 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:16.035707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:16.039130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:16.080172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:16.081001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.081827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.082108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.096271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:16.103338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:16.113166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 13/25] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:16.129273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:16.170168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:16.217777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:16.286514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de6cc-fc91-459d-b956-d4036d200db1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:16.351196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:16.351912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.352195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.352469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.353223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:16.353529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:16.354933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196905-a53a-4e0a-be9b-8e2d967435e2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:16.381258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 14/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:16.383025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fb20-76a8-482b-a0c6-d6a066b0f2e2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.383680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fb20-76a8-482b-a0c6-d6a066b0f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.384615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fb20-76a8-482b-a0c6-d6a066b0f2e2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.386939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:16.393850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6fb20-76a8-482b-a0c6-d6a066b0f2e2 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:16.431008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda50040-4c49-4cdc-bbf1-0a7cfc61b044 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:16.474079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:16.475017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.475439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.475869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.476743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:16.478275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:16.528106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6fb20-76a8-482b-a0c6-d6a066b0f2e2 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:16.561900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:16.562735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.563020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.563293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.564535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:16.566614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3a269-229d-4692-9294-06855ae914b9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:16.568707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 16/29] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:16 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:16.569858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.570145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.570421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.587735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:16.589077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:16.696961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 17/30] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:16.697588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:16.793773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 14/31] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 12 07:59:16 2022] POST /identity/v3/roles => generated 219 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:16.795406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:16.829768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6c665-9f88-49d9-aa0c-8c8e73b4bc1f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:16.874516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:16.875644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.876085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.876978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.878782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:16.880474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7be13f-4704-4e44-9e21-ffb93a40b6fb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:16.882839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 18/32] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:16.884370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb745-c4d4-4830-b322-c14fc4046a74 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:16.885803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb745-c4d4-4830-b322-c14fc4046a74 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:16.886238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb745-c4d4-4830-b322-c14fc4046a74 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:16.888321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 19/33] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:16.889203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb745-c4d4-4830-b322-c14fc4046a74 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:17.009367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb745-c4d4-4830-b322-c14fc4046a74 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.044998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73079e6-9bdb-4a5d-91f0-e87d91e52614 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.050279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.051152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.051432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.051741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] PATH_INFO: `/v3/domains/default/users/6096b896d07e4c27995c80c998efa491/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.054272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6096b896d07e4c27995c80c998efa491, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.055778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.083806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.084635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.085012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.085359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.095889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.098146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.117953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-e42278e1-e7ab-4a1a-9a6a-dfa9bc89121f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 07:59:17.119539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 15/34] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:17.120903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.121192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.121466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.138932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:17.140563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:17.229579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 16/35] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:17.230807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:17.264229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 20/36] 10.222.0.23 () {58 vars in 1361 bytes} [Tue Apr 12 07:59:16 2022] PUT /identity/v3/domains/default/users/6096b896d07e4c27995c80c998efa491/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:17.265553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:17.354479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543342b-5992-4ffe-a80a-561efd767895 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.380909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b7c-ae02-44f6-8003-1cb52e2f4461 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.403032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.404544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.405054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.405778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.406878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:17.407754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.409868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.418404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.419250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.420198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.420198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.420864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.422538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911dd93-4c09-4aab-a4b3-602d9a38df4a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.426218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 17/37] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:17.432118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:17.501276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 21/38] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:17.503066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb0ea-da69-465d-9b21-3c1681073db7 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.503369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb0ea-da69-465d-9b21-3c1681073db7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.503721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb0ea-da69-465d-9b21-3c1681073db7 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.510837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 22/39] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:17.513049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.513655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.514014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.536345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:17.538088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:17.566086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfe413-4444-458a-94a4-ccb2b1cf6215 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.604875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.605512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.605883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.606198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.607238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.608825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06a664-6c95-4af1-9a5e-0952461f1b3c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.629165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 23/40] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:17.653921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:17.704544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 18/41] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/projects => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:17.766685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78641e4-22f4-4925-8fb7-27b8ac6be1e0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:17.783982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097de80-7036-4613-ab86-326de37148a4 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.783982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097de80-7036-4613-ab86-326de37148a4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.784855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097de80-7036-4613-ab86-326de37148a4 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.786267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 19/42] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:17.793392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.793722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.793963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.808867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:17.809985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:17.810526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:17.811002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:17.812036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:17.813802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:17.818598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:17.820050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:17.880674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 24/43] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/roles => generated 223 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 07:59:17.905202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 20/44] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:17.937030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:18.059411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb31ef5-156a-4687-aafa-1e9b0b98e72a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:18.094061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:18.094873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:18.095165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:18.095443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:18.097312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:18.098781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f26d9-75e8-465c-b065-78804bf25a8c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:18.100635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 25/45] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:18.106009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:18.202481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a479ca-90fd-4c8b-bc7c-66751942ab8d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:18.234594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:18.235262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:18.235581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:18.235861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:18.236583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:18.238193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df921c4d-2d1e-4675-8949-1073d714baf9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:18.319109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 21/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 07:59:18 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:19.734540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f3bcc-60a9-4692-91d7-ca5e423f3d07 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:19.735052 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f3bcc-60a9-4692-91d7-ca5e423f3d07 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:19.735134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f3bcc-60a9-4692-91d7-ca5e423f3d07 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:19.736485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 26/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:19.741707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:19.742097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:19.742379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:19.758990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:19.760202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:19.822954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:19.846803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f3bcc-60a9-4692-91d7-ca5e423f3d07 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:19.941768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f3bcc-60a9-4692-91d7-ca5e423f3d07 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:19.973917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:19.974702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:19.974983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:19.975255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:19.984843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:19.993169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:19.994383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 27/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:20.000121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.091570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d298f-ecca-42f4-b8d5-dd90ca37a216 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:20.122942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:20.123645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.123924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.124196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.124929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:20.125233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:20.126602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:20.137959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 23/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:20.143342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.237610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edd2c-36ba-471c-8e4e-f2a63e5a8bef None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:20.272599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:20.273470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.273750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.274020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.275466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:20.276936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:20.278571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 28/51] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:20 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:20.284047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.379483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6f88-8972-4195-b4e3-6b8ce18fdb42 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:20.411138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:20.411960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.412244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.412520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.413671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:20.415123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f2b4-7462-486b-b016-5ac3f21a2de8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:20.416760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 24/52] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:20.422405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.515176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072fc4c-37c0-41e7-ae50-c794234ac25a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:20.546244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:20.546892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.547176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.547452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.548303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.domain.id=default, user.id=6096b896d07e4c27995c80c998efa491) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:20.548619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:20.550675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bc5dc-4508-431f-9354-5e0b153ef3dd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:20.556233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 29/53] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Apr 12 07:59:20 2022] GET /identity/v3/role_assignments?user.id=6096b896d07e4c27995c80c998efa491&scope.domain.id=default&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 530 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:20.626218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dcc9-b6db-4b10-ba43-1dc90231d00d None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.626505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dcc9-b6db-4b10-ba43-1dc90231d00d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.626788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dcc9-b6db-4b10-ba43-1dc90231d00d None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.628760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 25/54] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:20.634639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.634936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.635223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.653218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:20.654454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:20.721672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 30/55] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:20.747014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45dcc9-b6db-4b10-ba43-1dc90231d00d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.847900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45dcc9-b6db-4b10-ba43-1dc90231d00d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:20.879053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:20.879862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:20.880143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:20.880417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:20.881603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:20.883032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01039259-150c-48c7-80a3-34fe8eefe4ae None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:20.884765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 26/56] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:20.890426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:20.983706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f1da-3b01-4458-9e14-b46687208885 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:21.014297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:21.014951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:21.015240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:21.015544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:21.016246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:21.017683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12dc59-a694-45b7-8e84-52492418e464 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:21.113604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 31/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Apr 12 07:59:20 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:23.387742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4591b9-9325-4535-9472-2dc3c38064d2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:23.388268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4591b9-9325-4535-9472-2dc3c38064d2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:23.388368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4591b9-9325-4535-9472-2dc3c38064d2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:23.389658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 27/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:23.395516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:23.395900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:23.396082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:23.412820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:23.414006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:23.476471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 32/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:23.501482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4591b9-9325-4535-9472-2dc3c38064d2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:23.596938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4591b9-9325-4535-9472-2dc3c38064d2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:23.628024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:23.628801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:23.629085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:23.629365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:23.630526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:23.631993 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c77b47-e404-4a9f-9e41-d5918fd92b40 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:23.633551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 28/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:23.638816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:23.729830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9bb14-fc57-40d1-ad9d-01cc3fa8f371 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:23.761482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:23.762146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:23.762429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:23.762707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:23.763432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:23.766181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4c623-2671-4fc3-a9ac-1ef37aeeee8f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:23.832445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 33/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:23 2022] POST /identity/v3/users => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 07:59:27.246858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1783-459a-4d9d-9407-bdb2b95ec242 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.247892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1783-459a-4d9d-9407-bdb2b95ec242 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.248387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1783-459a-4d9d-9407-bdb2b95ec242 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.250225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 29/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:27.256184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.257003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.257503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.284501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:27.286093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:27.356206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a7f8f-274b-4cf7-b4c4-2bb081dbf7b7 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.356814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a7f8f-274b-4cf7-b4c4-2bb081dbf7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.357311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a7f8f-274b-4cf7-b4c4-2bb081dbf7b7 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.359112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 30/63] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:27.364482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d3ea-f8d1-4e82-8aa3-e841999657c2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.365036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d3ea-f8d1-4e82-8aa3-e841999657c2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.365508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d3ea-f8d1-4e82-8aa3-e841999657c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.384593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:27.396213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d1b6d3ea-f8d1-4e82-8aa3-e841999657c2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:27.397705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d1b6d3ea-f8d1-4e82-8aa3-e841999657c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:27.429736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.505506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 31/65] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:27.506908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6973c-6a2c-49e3-a997-f1b2fa8d4aaf None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.507209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6973c-6a2c-49e3-a997-f1b2fa8d4aaf None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.507511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6973c-6a2c-49e3-a997-f1b2fa8d4aaf None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.512723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 32/66] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:27.514279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.514574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.514857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.531840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:27.533012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:27.553343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4b54-243b-4f0d-9d71-1045de9347bb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:27.587175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:27.588007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.588291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.588567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.601472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:27.609786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 33/67] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:27.610032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:27.611103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.611579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 35/68] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:27.620484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.728169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501035b-2665-462f-a8f7-e2ffc89abda4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:27.736360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281985-0fc8-497f-9fb1-75145ab81d6b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:27.760858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:27.761753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.762039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.762319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.763066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:27.763373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:27.764791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:27.774853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 36/69] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:27.775698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.787028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:27.787914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.788205 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.788487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.804016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:27.812041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:27.813621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 34/70] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:27.814539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.882270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ebcd-3952-4ba1-a691-37c88301df5c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:27.915497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229ddf-f94b-4f31-8fb0-73731013c46e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:27.917237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:27.918820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.919113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.919394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.931485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:27.942152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:27.943551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 37/71] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:27.944332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:27.956313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:27.957192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.957479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.957753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.973030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:27.974485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174bc7c-ebe7-4cc6-8eac-4aa6935e0823 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:27.976192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 35/72] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:27.977404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1192e-3173-42e0-874f-4b33357aca60 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:27.977688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1192e-3173-42e0-874f-4b33357aca60 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:27.977965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1192e-3173-42e0-874f-4b33357aca60 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:27.979337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 36/73] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:27.979902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1192e-3173-42e0-874f-4b33357aca60 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.051934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28915e5-7194-4194-ace9-cf41e1e00a05 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.081471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1192e-3173-42e0-874f-4b33357aca60 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.083830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.084492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.084773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.085048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.085793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:28.086100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.087496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.095177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.095991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.113381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.114050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.114334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.114609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.115343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:28.115678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.117039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466bd5-25d7-4006-adef-fe30ced58158 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.124656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.125673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b605-cbde-4c39-9b9b-85cc773abaae None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.125965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b605-cbde-4c39-9b9b-85cc773abaae None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.126247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b605-cbde-4c39-9b9b-85cc773abaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.142004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d5d2b605-cbde-4c39-9b9b-85cc773abaae None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:28.143818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d5d2b605-cbde-4c39-9b9b-85cc773abaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:28.190455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab516-158f-42f8-aff8-b2ed647655c4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.208883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 38/76] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:28.210191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9582c-7869-457f-97cb-177ab479b01b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.210484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9582c-7869-457f-97cb-177ab479b01b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.210765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9582c-7869-457f-97cb-177ab479b01b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.212199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 39/77] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:28.212775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9582c-7869-457f-97cb-177ab479b01b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.223305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.223991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.224294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.224578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.288626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.290109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec61a-9699-4103-8517-2ad965bb73a3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.308628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9582c-7869-457f-97cb-177ab479b01b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.340911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.341785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.342074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.342355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.343573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.345022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.346631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.347497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.387296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:28.388612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.388885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.389164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.404822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:28.406000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:28.440793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ec73-c0ef-4781-b27f-d79de612470b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.467346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 40/80] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:28.468195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.479694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.480562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.480857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.481121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.482328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.483814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.490176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 41/81] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.490176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.562815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5b15-7ed0-429e-ad3d-6f466970a6b7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.581376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ffbc-94d7-472e-b52f-25acecfa2ddc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.594334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.595129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.595417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.595726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.605738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:28.613191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.613350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:28.613831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.614113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.614385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.614810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:28.615501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.680891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.682622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.706889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ccf0-41ca-4d6d-881d-12ec56c0eb26 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.738561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.739405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.739717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.739998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.741180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.742627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.744591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 42/83] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.745103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.772775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:28.773602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.840820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dcf8b-30f7-4abb-a1f5-6e2064d0ea44 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.865760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058eb93-8af7-43b1-b3cb-e63a7989f504 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:28.872341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.872979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.873264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.873538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.897049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:28.897837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:28.898119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:28.898391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:28.899875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.902084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:28.905217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 43/85] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:28.906461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:28.941787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:28.943260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.002431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6994-3844-4b30-974e-8f72b5ea5843 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.034630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.035297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.035616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.035899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.036027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:29.036642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:29.036849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.036936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.038321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.046380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.047020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.130327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7029fd0-28e1-42ba-b5be-4469fd205284 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.138452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6d3f-b8a9-4cf6-9bb5-8efff6e4dd71 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.162406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.163139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.163511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.163805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.164641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:29.166281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.166423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.171916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.172070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=782e17093ca8451595a9135e239dc30b => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.172790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.172882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.173245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.173331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.175164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.184309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.184309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.184309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.288364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844484c2-b047-400b-b07f-7d7470728fe2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.288570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918a991-cc15-473f-85bb-5cfe7ae4bf2c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.322694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.323241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.323650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.323727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.323993 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.324086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.324228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.324450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.324675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.325714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.326146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.327181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.328947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 46/90] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.329722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.423900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 45/91] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:29 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:29.423900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.428927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834b2b-e7b7-4b94-b4d2-46e612ddeb37 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.465731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.466638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.466987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.467277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.468595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.470068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.472639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 47/92] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.473908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.542425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ecf8c-dc36-4123-9d93-d9f80e584ce0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.579302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.580305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.581299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.581718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.582730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=6096b896d07e4c27995c80c998efa491) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:29.583198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.584407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606def83-6400-4197-b9ed-14e378950ed3 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.585048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.591238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 46/93] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/role_assignments?user.id=6096b896d07e4c27995c80c998efa491&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.592457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:29.620969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.621653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.621945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.622229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.623145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:29.623492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.625059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.635282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:29.706524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59155476-8da6-49de-95ac-05e46eb1b256 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:29.746753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:29.747878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:29.748386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:29.748857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:29.826035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:29.832482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:29.942092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:29.947755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:30.070983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3006-5173-4e26-833b-564f65f5d7fa None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:30.109613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:30.110490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:30.110771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:30.111047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] PATH_INFO: `/v3/projects/19ea409087954151b0d2392dc8bf50e0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:30.112305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] RBAC: Authorizing `identity:get_project(project_id=19ea409087954151b0d2392dc8bf50e0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:30.113760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e161-cd8f-4c9d-a946-9fa2e3b0331c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:30.115523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:29 2022] GET /identity/v3/projects/19ea409087954151b0d2392dc8bf50e0 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:30.121462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:30.242746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d84cc-228d-4f28-8a5a-fde6e86df469 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:30.279809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:30.280479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:30.280767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:30.281064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:30.281889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=19ea409087954151b0d2392dc8bf50e0, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:30.282209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:30.283750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17101699-2061-45d1-a82d-71f6cdd23347 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:30.289721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:30 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=19ea409087954151b0d2392dc8bf50e0&role.id=782e17093ca8451595a9135e239dc30b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:32.292672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae81c-9260-456f-9beb-8bcda9004fd7 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.293170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae81c-9260-456f-9beb-8bcda9004fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.293240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae81c-9260-456f-9beb-8bcda9004fd7 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.294896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:32.300352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.300753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.300917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.324499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:32.325740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:32.416815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:32.451375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae81c-9260-456f-9beb-8bcda9004fd7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:32.580141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae81c-9260-456f-9beb-8bcda9004fd7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:32.626953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:32.628679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.629162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.629632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.651389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:32.658808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-60b7e269-3b50-4be0-b1c1-efdf5548c92a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:32.660379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 51/100] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:32.666334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:32.678884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caff67c-1382-4744-8d78-9600ca7c65d5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.679501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caff67c-1382-4744-8d78-9600ca7c65d5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.680056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caff67c-1382-4744-8d78-9600ca7c65d5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.681627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 52/101] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:32.697998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69e82-9768-40ce-b679-eb284000bb34 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.698588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69e82-9768-40ce-b679-eb284000bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.699064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69e82-9768-40ce-b679-eb284000bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.732665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a5b69e82-9768-40ce-b679-eb284000bb34 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:32.734190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a5b69e82-9768-40ce-b679-eb284000bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:32.773414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0fc1b-d05a-4601-bc71-6f7a4f42a7fb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:32.815626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:32.816323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.816619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.816908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.817680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:32.817997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:32.819425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:32.837704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 50/102] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:32.844785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:32.894431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 53/103] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:32.896268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653ad8-6fea-49ae-9bcc-c67f0d9196d6 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.896801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653ad8-6fea-49ae-9bcc-c67f0d9196d6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.897279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653ad8-6fea-49ae-9bcc-c67f0d9196d6 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.899180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 54/104] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:32.906948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:32.907606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:32.908089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:32.941042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:32.942834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:33.018242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586960f-dddc-4fc5-98d8-9d53c755be70 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.043919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 55/105] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:33.044775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.093744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.094785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.095080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.095359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.099492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.099492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.104126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 51/106] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:32 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:33.104948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.192678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0c373-49c9-4ffe-bb34-b7e09ba6ca8d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.243166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.244391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.244875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.245348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.264111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53050-b9cc-4ce6-abd2-d68309c6c5ad None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.268802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:33.285009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:33.286867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 56/107] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:33.287886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.306866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.307715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.307997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.308269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.322936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:33.330847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:33.332673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 52/108] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:33.333681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.391263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443a0e-30ba-4c2d-83ef-583508afa1f0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.425591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.426693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.427160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.427668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.429044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.430810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bced0-b060-48bd-bed0-23d9f97fd374 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.432750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 57/109] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:33.434250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0043-1ccd-484f-9818-6612087faebb None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.434670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf4f3-697f-4453-a06e-e7889cd3d3a3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.434986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0043-1ccd-484f-9818-6612087faebb None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.435456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0043-1ccd-484f-9818-6612087faebb None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.436932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 58/110] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:33.442184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0043-1ccd-484f-9818-6612087faebb None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.469779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.470482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.470746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.471211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.472223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:33.472694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.474242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.483463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 53/111] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:33.484654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.552457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0043-1ccd-484f-9818-6612087faebb None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.587786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.588616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.588729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892f931-eb98-4bb0-9948-9e1557b0e186 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.589127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.589502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.590359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:33.590766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.592338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ccfe3-5fda-442b-b47d-b424d5c8c92a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.601335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 59/112] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:33.602721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.603113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.603514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.620640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:33.622137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:33.624976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.625883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.626172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.626452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.629009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, user_id=d89331b4cbbf45aa9d8f13cdb096ad69, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.630471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.685636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 60/113] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:33.687621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.712146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 54/114] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:33 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:33.720835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.815719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fa912-1756-4290-9d7b-3eddcedd6e5d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.849967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd118-1b47-466f-a797-0fb9d10913fe None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.855098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.856425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.856875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.857313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.859028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.860818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27deeae-b6ea-4d45-abf2-9139984c7992 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.862851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 61/115] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:33.864493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c2b-a7b5-4e23-832f-e9b9065d79e5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.864962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c2b-a7b5-4e23-832f-e9b9065d79e5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.865437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c2b-a7b5-4e23-832f-e9b9065d79e5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.866927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 62/116] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:33.867919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028c2b-a7b5-4e23-832f-e9b9065d79e5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:33.892435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:33.894042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.894334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.894611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.895921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:33.897399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23809d-5745-436f-b4ab-a48748771788 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:33.899109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 55/117] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:33.900649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:33.900941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:33.901223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:33.920371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:33.921563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:33.988567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 56/118] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:33.988750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028c2b-a7b5-4e23-832f-e9b9065d79e5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:33.989823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.032506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.033647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.034225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.034721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.045079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:34.052413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0cd5ca21-282a-4ce6-b91b-a50208a20ee7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:34.053765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 63/119] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:34.059688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864a26-1fd0-4412-8dd1-1942e6cd93f2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.059982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864a26-1fd0-4412-8dd1-1942e6cd93f2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.060266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864a26-1fd0-4412-8dd1-1942e6cd93f2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.063938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 64/120] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:34.063938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864a26-1fd0-4412-8dd1-1942e6cd93f2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.089296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff1bf-996d-405e-be01-02f07e969551 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.121733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.122598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.122888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.123165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.124404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.125857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.128115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 57/121] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:33 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:34.128967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.173632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864a26-1fd0-4412-8dd1-1942e6cd93f2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.209747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.210918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.211818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.212318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.214239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.216480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.218974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 65/122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:34.220000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.237979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72627ad-4198-49ac-81c1-6056b36277ec None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.270470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.271266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.271580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.271867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.273097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.274802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1557-b286-4c95-bd14-d860709114ad None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.276612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 58/123] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:34.277763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.278056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.278338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.295072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:34.296295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:34.322531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96001848-ecc1-47d2-96fa-d5a90eb0ca5b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.356328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.356930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.357213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.357495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.358237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:34.358552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.369061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 59/124] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:34.369658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.369753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.369822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 66/125] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:34.373795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.468359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462a8c3-c246-460e-bab1-2d1b85f87155 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.468707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a15d-1e19-47f7-a9fd-eeec700b6977 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.501304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.501762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.502759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.503039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.503254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.503347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/6096b896d07e4c27995c80c998efa491/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.503586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.503869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.505290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, user_id=6096b896d07e4c27995c80c998efa491, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.506182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, user_id=d89331b4cbbf45aa9d8f13cdb096ad69, role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.506740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.507671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.585965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 60/126] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:34 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/6096b896d07e4c27995c80c998efa491/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:34.586777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.623605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 67/127] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:34 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:34.623605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.792559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e997-07d1-44e7-b38f-027ab6310c57 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.811786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e91a9-981c-4222-baff-099d489e5994 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:34.836232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.836925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.837219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.837503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.838236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.839779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.859793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:34.860717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:34.860995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:34.861278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] PATH_INFO: `/v3/users/f78c7a388d35419187e072d02a8fc287` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:34.877649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] RBAC: Authorizing `identity:get_user(user_id=f78c7a388d35419187e072d02a8fc287)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:34.879099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:34.881224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 68/128] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/users/f78c7a388d35419187e072d02a8fc287 => generated 289 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:34.882064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:34.932229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 61/129] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 07:59:34 2022] POST /identity/v3/projects => generated 302 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:34.933529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.033911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9441-04b9-4fb3-bdc5-279688025460 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.095111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69ece-df55-465e-93f4-9e951a0b521f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.109022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.109855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.110146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.110428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.135894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:35.154631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:35.163280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 69/130] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:35.169161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.198543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.199283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.199603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.199888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.337146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:35.340305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:35.387353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249663-00e8-40e1-8cce-2b222fc90dc3 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.459362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.460075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.460368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.460658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.461417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:35.461731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:35.463134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:35.484690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 70/131] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:35.491836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.547807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 62/132] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:35.553383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.649970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eabefe-8c62-4e12-9574-d34e12ba4e60 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.676928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da48af-fa97-4810-9a99-cc25a401347d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.716799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.717833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.718128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.718413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.719802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:35.721503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:35.723229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 63/133] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:35 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:35.729760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.753312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.754217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.754503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.754778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.756033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:35.757486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:35.759423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 71/134] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:35 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:35.764711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:35.838613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76698-de4c-4010-85d8-89362214e2c9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:35.876708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:35.877283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:35.877575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:35.877860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:35.879143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=f78c7a388d35419187e072d02a8fc287) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:35.879495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:35.880972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:35.887394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 64/135] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:35 2022] GET /identity/v3/role_assignments?user.id=f78c7a388d35419187e072d02a8fc287&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:35.975759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13c18-772e-4ae8-8f59-1304184c949a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:36.041939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:36.043253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:36.043782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:36.044267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] PATH_INFO: `/v3/projects/19ea409087954151b0d2392dc8bf50e0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:36.048382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=19ea409087954151b0d2392dc8bf50e0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:36.050272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51589aba-2d60-4ed9-abd1-6d3542eac1c0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:36.052362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 72/136] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:35 2022] GET /identity/v3/projects/19ea409087954151b0d2392dc8bf50e0 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:36.058085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:36.197521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb31dd-530b-4df5-9382-36f3ce0d2e46 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:36.238690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:36.239549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:36.239847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:36.240130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] PATH_INFO: `/v3/projects/19ea409087954151b0d2392dc8bf50e0/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:36.242133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] RBAC: Authorizing `identity:create_grant(project_id=19ea409087954151b0d2392dc8bf50e0, user_id=d89331b4cbbf45aa9d8f13cdb096ad69, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:36.243624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39deedf-b92b-4f04-8e47-1e8dac13e42f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:36.335685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 65/137] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:36 2022] PUT /identity/v3/projects/19ea409087954151b0d2392dc8bf50e0/users/d89331b4cbbf45aa9d8f13cdb096ad69/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:36.664405 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe05d6-a790-42fe-801e-e27902bc2ad5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:36.664919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe05d6-a790-42fe-801e-e27902bc2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:36.664992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe05d6-a790-42fe-801e-e27902bc2ad5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:36.666363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 73/138] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:36.672338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:36.672825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:36.672904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:36.696059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:36.697269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:36.766907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 66/139] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:36.791233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe05d6-a790-42fe-801e-e27902bc2ad5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:36.895850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe05d6-a790-42fe-801e-e27902bc2ad5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:36.931914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:36.932711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:36.933000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:36.933283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:36.946902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:36.954894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:36.960852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 74/140] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:36.962923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:37.067869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d843d-379e-435f-9bf0-5bfc3c127759 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:37.102436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:37.103122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.103413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.103732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.104491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:37.104806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:37.106209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:37.115522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 67/141] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:37.121494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:37.235917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d6d-547a-48d8-bbe4-66446ac780de None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:37.272113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:37.273004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.273292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.273569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.275042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:37.276551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:37.278198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 75/142] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:37 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:37.284511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:37.402972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0c00-4a09-4463-9105-bfe7cf7dc88c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:37.439823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:37.440410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.440702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.441088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.516755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:37.518878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:37.633287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 68/143] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:37.639968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:37.752842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa7ed-c7cb-4a84-8216-334f6fc2dd7c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:37.801972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:37.803240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.803761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.804231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.808201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:37.809881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c5b9-225c-44a8-8646-ecd5823fe7e0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:37.811850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 76/144] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:37 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:37.818668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:37.904852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167901-88a1-4801-8437-577be033bb56 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.905497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167901-88a1-4801-8437-577be033bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.905979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167901-88a1-4801-8437-577be033bb56 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.911613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 77/145] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:37.913149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:37.913642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:37.914115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:37.952850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:37.953253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95174-82fc-477e-a5ce-7bf1c9f4eb62 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:37.954505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:38.012420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.013774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.014056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.014324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.015171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:38.015497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:38.018526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806741a-322c-4b41-adfd-64296b4bc387 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:38.031738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 69/146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:37 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=782e17093ca8451595a9135e239dc30b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:38.077170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61b57-8f50-40af-b723-7322f10a8ce8 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.077511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61b57-8f50-40af-b723-7322f10a8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.077735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61b57-8f50-40af-b723-7322f10a8ce8 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.079493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 70/147] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:38.093250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.093579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.093821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.110777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 78/148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:38.121566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:38.122908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:38.152035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.289037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 71/149] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:38.338524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.340201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bbed-17bf-449d-b562-a1186fd2319a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.382886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.383803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.384090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.384369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.405001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:38.412300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:38.413570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 79/150] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:38.429526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.476402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077820e3-85b1-488a-801c-2af55e750c63 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.517497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.518689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.519176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.519685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.538112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:38.546300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:38.547812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 72/151] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:38.554122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.556422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ef67-5da7-4274-92d7-bbd49ae6622c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.596235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.597008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.597285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.597575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.598318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:38.598630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:38.600057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:38.615148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 80/152] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:38.635277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.665528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f0137-7dcc-4178-bf74-1a20629f1839 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.706966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.708090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.708893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.710635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.711649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:38.713222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:38.714858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:38.731907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 73/153] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:38.738112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.818598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd8ce-96dd-4bb6-a127-5a0cc469f018 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.875427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1973-d7af-4e5e-8133-528b6703d190 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:38.889243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.890380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.890808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.891243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] PATH_INFO: `/v3/users/6096b896d07e4c27995c80c998efa491` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.893364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=6096b896d07e4c27995c80c998efa491)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:38.895023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a8162-3a8a-4c54-ab05-96697f3eb6f3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:38.896911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 81/154] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/users/6096b896d07e4c27995c80c998efa491 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:38.898367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963980-067d-4768-ba39-040e61b0864c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.898845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963980-067d-4768-ba39-040e61b0864c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.899303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963980-067d-4768-ba39-040e61b0864c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.905092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 82/155] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:38.906106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963980-067d-4768-ba39-040e61b0864c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:38.921087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:38.922066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.922355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.922633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.929796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:38.929796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1f68-69ae-46b4-8b0d-5381da7567dc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:38.929796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 74/156] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:38.930208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:38.930655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:38.931006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:38.957592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:38.959505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:39.025433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963980-067d-4768-ba39-040e61b0864c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.033940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 75/157] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:39.039697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.087067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.088216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.088701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.089204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.134084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f7cd-266e-4f23-96cf-38e81c9bd0f6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.159822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.161637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.170477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.170879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.171165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.171445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.259051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.261002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.263579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 83/158] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:39.264766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.380271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 76/159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:39.385304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.386392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83df1b-0776-42b9-960e-a8e9594aeeae None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.420540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.421334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.421612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.421883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.423050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.424663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470caa84-1e2f-414e-8d97-2e3a8984ea99 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.426448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 84/160] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:39.427443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd561e-ea72-4cf7-8dc2-78fa316cfd3a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.427754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd561e-ea72-4cf7-8dc2-78fa316cfd3a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.428030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd561e-ea72-4cf7-8dc2-78fa316cfd3a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.429396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 85/161] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:39.432269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd561e-ea72-4cf7-8dc2-78fa316cfd3a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.486954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4863-b7e8-4c1c-aea8-d290e7e59e11 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.520226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.521225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.521512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.521795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.522983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.524822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.526687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 77/162] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:39.527358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.536472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd561e-ea72-4cf7-8dc2-78fa316cfd3a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.569637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.570498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.570781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.571059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.572281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.573721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20af23-d58c-4493-9fe9-8c11a59860bd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.580282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 86/163] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:39.580282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.580282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.580282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.593890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:39.595052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:39.638304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0a02-6e84-4211-a4e1-402ff0075cfe None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.664002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 87/164] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:39.668787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.679405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.680356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.680536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.680911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.681785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.683321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.765501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa884dd-6b12-4e50-8ad6-aad6c70e4b81 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.780169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 78/165] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:39 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:39.785510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.799458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.800500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.800789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.801062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.802456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=6096b896d07e4c27995c80c998efa491) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:39.802456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.803759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.819513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 88/166] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/role_assignments?user.id=6096b896d07e4c27995c80c998efa491&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:39.819513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:39.913624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb476c4-4d12-45c1-8a71-503ae251ff28 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.929174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07ddf5-eabf-4182-9a10-f3fb18b460ba None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:39.951716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.952396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.952680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.952957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.953817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:39.954131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:39.955750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a272c4-909b-46f7-b3d9-6de67d075c73 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:39.962506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 79/167] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:39.963939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28aed-1ab2-41db-9f88-ccc28680c096 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.964232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28aed-1ab2-41db-9f88-ccc28680c096 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.964511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28aed-1ab2-41db-9f88-ccc28680c096 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.966204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 80/168] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:39.967713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:39.968617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.968906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.969187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.973131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:39.973417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:39.973721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:39.995824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:40.004293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:40.005595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 89/169] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:40.013974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.015390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:40.017103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:40.117282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 81/170] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:40.147905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.150094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1506d0-5ad8-4430-ac24-0ae53d91f233 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.189326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.189935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.190219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.190497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.191245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:40.192683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.193163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.202435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 90/171] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:40.212813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.289622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f34d-bdcb-4c66-bab8-03ccbcef42c2 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.328125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.329073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.329367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.329643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.342132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:40.342698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b585e6-10ad-47e6-a31d-8c945f2718a4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.350099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:40.351888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 82/172] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:40.357505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.383693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.384887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.385347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.385795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] PATH_INFO: `/v3/users/f78c7a388d35419187e072d02a8fc287` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.387210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] RBAC: Authorizing `identity:get_user(user_id=f78c7a388d35419187e072d02a8fc287)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.388893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.390541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 91/173] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/users/f78c7a388d35419187e072d02a8fc287 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:40.397707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.484180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3971e5-4602-4512-86b1-293d3d5dc0a5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.510547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2baa36-5e29-467c-bcae-1eff4a127360 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.525335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.526386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.526953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.527238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.528195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:40.528561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.530262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.542175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 83/174] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:40.547704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.550881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.551785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.552069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.552348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.553544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.554986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.556946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 92/175] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:40.562114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.653675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0bff-9478-4c41-a36b-cc5c65dcf2f7 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.663772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6547-bc01-4836-817e-2963ed382b1d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.690277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.691157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.691440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.691750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] PATH_INFO: `/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.692979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d89331b4cbbf45aa9d8f13cdb096ad69)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.694433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.696109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 84/176] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/users/d89331b4cbbf45aa9d8f13cdb096ad69 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:40.698793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.699718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.699999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.700273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/f78c7a388d35419187e072d02a8fc287/roles/42081763a1bd4d9ebd4a01a55f939275` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.701803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:40.702260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, user_id=f78c7a388d35419187e072d02a8fc287, role_id=42081763a1bd4d9ebd4a01a55f939275)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.703740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:40.780962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 93/177] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:40 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/users/f78c7a388d35419187e072d02a8fc287/roles/42081763a1bd4d9ebd4a01a55f939275 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 07:59:40.828125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c797c-4b83-4980-9954-b59d59d1b7e5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:40.864893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:40.865558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:40.865888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:40.866169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:40.940063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:40.941560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:41.055245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 85/178] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:41.060876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:41.165416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f4b7-9eed-4c0a-8966-1318418cfdce None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:41.210425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:41.211283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:41.211593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:41.211870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] PATH_INFO: `/v3/projects/19ea409087954151b0d2392dc8bf50e0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:41.213077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] RBAC: Authorizing `identity:get_project(project_id=19ea409087954151b0d2392dc8bf50e0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:41.214540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30a75-6058-4539-826a-75b2c2ecabef None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:41.216269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 94/179] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:41 2022] GET /identity/v3/projects/19ea409087954151b0d2392dc8bf50e0 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:41.222179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:41.326097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e3e57-a20c-43e6-b7b6-affe550532b0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:41.363640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:41.364303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:41.364589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:41.366423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:41.366423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=19ea409087954151b0d2392dc8bf50e0, user.id=d89331b4cbbf45aa9d8f13cdb096ad69) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:41.366423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:41.367513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9437-5592-4a92-8c1a-640ffa1a5c95 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:41.373790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 86/180] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:41 2022] GET /identity/v3/role_assignments?user.id=d89331b4cbbf45aa9d8f13cdb096ad69&scope.project.id=19ea409087954151b0d2392dc8bf50e0&role.id=782e17093ca8451595a9135e239dc30b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:42.586802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba7f3-269c-41e3-beb0-83279b16cb67 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:42.587513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba7f3-269c-41e3-beb0-83279b16cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:42.587513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba7f3-269c-41e3-beb0-83279b16cb67 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:42.588676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 95/181] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:42.594044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454d013-4a8b-49b7-8388-44ba5049805d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:42.594547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454d013-4a8b-49b7-8388-44ba5049805d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:42.594714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454d013-4a8b-49b7-8388-44ba5049805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:42.614290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7454d013-4a8b-49b7-8388-44ba5049805d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:42.616262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7454d013-4a8b-49b7-8388-44ba5049805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:42.687376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:42.711758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba7f3-269c-41e3-beb0-83279b16cb67 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:42.811979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba7f3-269c-41e3-beb0-83279b16cb67 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:42.843903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2649-8478-4f86-be85-a164319aa1bf None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:42.844181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2649-8478-4f86-be85-a164319aa1bf None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:42.844378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2649-8478-4f86-be85-a164319aa1bf None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:42.846401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 88/183] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:42.850290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:42.851038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:42.851325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:42.851635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:42.852270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:42.852741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:42.853192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:42.862399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:42.869546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:42.870462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:42.871071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 96/184] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:42.872096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:42.876440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:42.949084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 89/185] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:42.968616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:42.992086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedb7e9-7618-4666-92ad-c331e5f241c1 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.028034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.029044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.029522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.029989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.031004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:43.031552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.033166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb7d8-a745-4df4-80b1-09f596e69c36 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.041697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 97/186] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:43.043454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594298-7167-4f01-abd4-72e0a29df4ea None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.043991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594298-7167-4f01-abd4-72e0a29df4ea None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.044512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594298-7167-4f01-abd4-72e0a29df4ea None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.046149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 98/187] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:43.047103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75594298-7167-4f01-abd4-72e0a29df4ea None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.080689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c7897-6d95-4f98-a045-afec8f1afe0c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.113227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.113967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.114255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.114530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.124466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:43.132403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-f6eda560-04ee-4049-a444-cc66c1192d66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:43.133608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 90/188] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:43.138456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.138456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.138456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.152552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75594298-7167-4f01-abd4-72e0a29df4ea None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.152890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:43.154089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:43.195648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.196770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.197228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.197674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.211432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.213154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.215125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 99/189] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:43.216075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.229907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 91/190] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:43.230609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.315233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa3ac-5f96-4478-98fc-0c216735b108 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.331943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43faf-5c32-4e4e-ad93-740930a12fa0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.347638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.348310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.348592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.348871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.349612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:43.349918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.351288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.359273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 100/191] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:43.364843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.365558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.366205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.366484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.366756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.435513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.436986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.466157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a974a5-2cc1-46b2-aaa7-d6a56e598987 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.498798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.499622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.499908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.500180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.501334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.503386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.507719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 101/192] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:43.507719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.537694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 92/193] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:43.538510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.605583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc34ab-2fbb-46c3-8b7c-d865befcb5cb None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.629187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa0e35-0d45-48ca-96ee-a9bad4b8bbb1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.636832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.637699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.637980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.638254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.639511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.641038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460a8c-e3e7-4a39-a507-27f1fe836342 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.642690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 102/194] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:43.644742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7454-855d-45df-abe1-5fabe39451f9 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.645031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7454-855d-45df-abe1-5fabe39451f9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.645304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7454-855d-45df-abe1-5fabe39451f9 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.646719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 103/195] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:43.647241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7454-855d-45df-abe1-5fabe39451f9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.662556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.663247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.663556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.663835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.664544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.665995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.739832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 93/196] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:43 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:43.740652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.742273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7454-855d-45df-abe1-5fabe39451f9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.780546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.781431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.781712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.782008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.783893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.789347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b28c0-7351-4a8f-9cbf-243fce43e024 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:43.789347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 104/197] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:43.789347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.789347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.789347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.806640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:43.807990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:43.848115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d7bf-d3d3-4b06-9ab2-1b4553c4197e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:43.887585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:43.887585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:43.887851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:43.887851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:43.887851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:43.887851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:43.955884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:43.957396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.016113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173add-26ae-4111-87fc-343fdc4870b3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.056216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.057108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.057549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.057957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.058917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=a45e37e4f8a04631b8fc43db6d520956) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:44.059365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.060991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.066883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 106/199] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/role_assignments?user.id=a45e37e4f8a04631b8fc43db6d520956&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:44.072387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.075765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 94/200] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:44.082136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.206086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d9b3-4d77-427b-9d52-76c7e98b4184 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.229103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698317c-8dba-4cc6-afb8-1fdba1fb2ed2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.265293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.266162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.266448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.266728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.271259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.273913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.276608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 95/201] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:44.278743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.279761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.280185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.280600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.284182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.295988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:44.305316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:44.306908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 107/202] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:44.312614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.389888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5b0c-8d48-4316-a9fe-3ef8dcbe2b72 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.418952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094547-412f-4e73-8391-0ddbd62b8676 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.423937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.424592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.424875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.425149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.425972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=a45e37e4f8a04631b8fc43db6d520956) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:44.426282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.427880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.439754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 96/203] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/role_assignments?user.id=a45e37e4f8a04631b8fc43db6d520956&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:44.457939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.458988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.459532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.460004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.461085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:44.461598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.463243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.473333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 108/204] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:44.479156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.588615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5279be4-2dca-4255-b8a9-e90863e5bda3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.622977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.623901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.624178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.624448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] PATH_INFO: `/v3/users/f78c7a388d35419187e072d02a8fc287` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.625766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] RBAC: Authorizing `identity:get_user(user_id=f78c7a388d35419187e072d02a8fc287)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.627788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.633795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 97/205] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/users/f78c7a388d35419187e072d02a8fc287 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:44.635141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:44.742971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979dc7-9668-41f2-9171-1a0b40a2d45e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:44.778198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:44.778854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:44.779134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:44.779404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:44.868201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:44.869668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:44.980572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 109/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:44.986406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:45.145042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e97ed-2229-43f8-b7a2-c1bc5330acd9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:45.201742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:45.202606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:45.202885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:45.203156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:45.208197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:45.209644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7867-6743-41db-85b4-ac95b6927fee None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:45.211705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 98/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:44 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:45.217428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:45.356873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5c45-e8d2-4008-a086-3bdf01e4b97c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:45.408823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:45.409411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:45.409694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:45.409971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:45.410802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c, user.id=f78c7a388d35419187e072d02a8fc287) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:45.411114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:45.412591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee92e7f-649b-4ed2-9fb6-37bb73af8e06 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:45.421547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 110/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:45 2022] GET /identity/v3/role_assignments?user.id=f78c7a388d35419187e072d02a8fc287&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:46.464425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0aacc-78b7-4ab3-9ce8-e123ff736b7d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.464919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0aacc-78b7-4ab3-9ce8-e123ff736b7d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.464919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0aacc-78b7-4ab3-9ce8-e123ff736b7d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.466387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 99/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:46.472596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.473563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.474050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.492240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:46.493971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:46.563435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 111/210] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:46.588150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0aacc-78b7-4ab3-9ce8-e123ff736b7d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:46.715204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0aacc-78b7-4ab3-9ce8-e123ff736b7d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:46.749358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:46.750537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.751029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.752075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.762834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:46.770827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c244106f-84ad-41b8-9a1f-a5c070f5774d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:46.772607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 100/211] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:46.778704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:46.785014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81757a-8ddc-4937-9ec0-1cf204aa9941 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.785301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81757a-8ddc-4937-9ec0-1cf204aa9941 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.785576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81757a-8ddc-4937-9ec0-1cf204aa9941 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.787187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 101/212] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:46.792189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10cc6-1c14-45bf-a90e-2b9afcc3f54a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.792470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10cc6-1c14-45bf-a90e-2b9afcc3f54a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.792745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10cc6-1c14-45bf-a90e-2b9afcc3f54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.808974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-24e10cc6-1c14-45bf-a90e-2b9afcc3f54a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:46.810174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-24e10cc6-1c14-45bf-a90e-2b9afcc3f54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:46.877442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 102/213] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:46.879188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2a4d-9934-4591-89c9-c2e7b233ea96 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.880138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2a4d-9934-4591-89c9-c2e7b233ea96 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.880626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2a4d-9934-4591-89c9-c2e7b233ea96 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.882579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 103/214] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:46.888486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.889014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.889646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.893483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2022b-6ec0-48af-8ea5-0421f9304bf7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:46.909711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:46.910876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:46.927659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:46.928328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:46.928604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:46.928872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:46.929604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:46.929906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:46.931267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:46.939589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 112/215] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:46.939589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:46.984282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 104/216] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:46.985046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.060737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7ba9-5abb-40ce-ae1e-2cea1471f294 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.091414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863f36-22d2-46d4-87c9-251d0bb0206b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.091963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.092753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.093028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.093295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.094517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.096604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.098238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 113/217] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.099068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.124834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.125698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.125974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.126248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] PATH_INFO: `/v3/users/6061c8460476491a970601b0cae8cab2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.138553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6061c8460476491a970601b0cae8cab2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.140036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a395c-90ba-4edc-b92e-3030f65621a2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.141668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 105/218] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:46 2022] GET /identity/v3/users/6061c8460476491a970601b0cae8cab2 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.143348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b78-8b3e-4efc-995d-1278fb351801 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.143651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b78-8b3e-4efc-995d-1278fb351801 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.143921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b78-8b3e-4efc-995d-1278fb351801 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.145297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 106/219] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:47.147503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8318b78-8b3e-4efc-995d-1278fb351801 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.191071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973edcb0-2d9f-46ec-b2fc-59ca02ad8e0e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.222515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.223290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.223599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.223872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.233311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:47.240300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:47.241430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 114/220] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:47.242179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.242864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8318b78-8b3e-4efc-995d-1278fb351801 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.277301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.278406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.278875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.279223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.279970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.281435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7d22e-b9e2-420b-81c6-5416cddb508a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.339175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc430b-49da-41b6-a9f9-6055b3c08edf None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.362667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 107/221] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:47 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:47.364688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.365079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.365580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.371924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.372605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.372898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.373204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.384880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:47.388136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:47.450081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.451582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.457639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 108/222] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:47.458523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.560044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146d69a-c9d3-4732-b40d-51ff8d61d190 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.578670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 115/223] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:47.583241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.596155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.596832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.597117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.597394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.598141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:47.598463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.599896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.608914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 109/224] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.615141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.704110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f051-792f-43bc-b9b3-aba8b7c1b1f7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.737251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d0b63-a483-45a9-931b-4b4d2a42af17 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.747268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.748436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.748736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.749018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.762406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:47.773066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:47.773621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.774313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 116/225] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:47.775181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.775353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.775887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.776374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.777931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.779932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.782067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 110/226] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.783075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.889305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ca36-ddbd-4551-826a-a03b10902607 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.899929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43659b28-74e5-425c-935d-e6ef2c18be23 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:47.923866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.924827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.925350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.925840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.926784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:47.927293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.928977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.937645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 111/227] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.938703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:47.939421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:47.940684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:47.940968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:47.941242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:47.942694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:47.945085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:47.946990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 117/228] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:47.947786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:48.052919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086fce-4596-44df-ba97-33c99db989bc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.056611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e93f3-85e5-4aba-933d-7a0079ebb388 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.091399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.092354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.092702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.093052 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.093525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.093624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.093843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.094119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.095032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=6061c8460476491a970601b0cae8cab2) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:48.095917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.096277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.097357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.098078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.099142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 118/229] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:48.099754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:48.104629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 112/230] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:47 2022] GET /identity/v3/role_assignments?user.id=6061c8460476491a970601b0cae8cab2&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=782e17093ca8451595a9135e239dc30b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:48.111609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:48.219343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67238d-17a3-4d80-95e7-fa1fd25e1fd7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.260465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.261829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.262261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.262542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.263998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.265658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.267526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 119/231] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:48 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:48.273489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:48.313674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd0145-9379-4ec1-9d8a-fd590f3c212d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.348737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.349618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.349895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.350418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.351617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.353082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.355047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 113/232] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:48 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:48.360588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:48.397162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07e88-5d5d-4b54-9a7f-a317d1beefe6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.430975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.431937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.432223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.432504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/a45e37e4f8a04631b8fc43db6d520956/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.434470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, user_id=a45e37e4f8a04631b8fc43db6d520956, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.435957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65075b63-8439-424d-8870-bd9768f4b3a9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.473293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e3be-8790-482e-8b40-fb6e9a85faee None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:48.507408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:48.508329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:48.508619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:48.508892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/a45e37e4f8a04631b8fc43db6d520956/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:48.511163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, user_id=a45e37e4f8a04631b8fc43db6d520956, role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:48.512652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0046-271d-4b50-8726-0f693d01f106 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:48.516979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 120/233] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:48 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/a45e37e4f8a04631b8fc43db6d520956/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 07:59:48.598967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 114/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:48 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/a45e37e4f8a04631b8fc43db6d520956/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 07:59:50.229527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8966-a46a-44f8-8b74-982a7dff760a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.230010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8966-a46a-44f8-8b74-982a7dff760a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.230105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8966-a46a-44f8-8b74-982a7dff760a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.231602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 121/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:50.237358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.237773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.237937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.259681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:50.260874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:50.318394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c17b8-07d7-42ae-b773-91150abd83be None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.318707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c17b8-07d7-42ae-b773-91150abd83be None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.318948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c17b8-07d7-42ae-b773-91150abd83be None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.320334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 122/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:50.325984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.335289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.335289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.353845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:50.355081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:50.358471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 115/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:50.403733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:50.429887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 123/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:50.492275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:50.518195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36b55-40e2-4301-bb1a-e996030ba12f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:50.564725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:50.565545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.565828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.566104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.580875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:50.588178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:50.589401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 116/239] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:50.595481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:50.616708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd4f0-2348-4fa6-884d-b20ae522cc70 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:50.653576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:50.654398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.654677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.654950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.656167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:50.657682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:50.659632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 124/240] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:50.665025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:50.770983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8682ea-2b75-478d-9bb1-782cf9c9582b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:50.810078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:50.811291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.811788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.812297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.813214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:50.815499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:50.843529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec861-9a43-49e6-9e62-7b27c32768ec None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:50.875507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:50.876284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:50.876573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:50.876852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:50.877671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:50.877980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:50.879516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:50.893726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 117/241] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:50.895065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:50.916686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 125/242] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:50 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 07:59:51.008305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd3cd-9bb8-4684-ac40-db1e45f63453 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.044475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.045284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.045570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.045847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] PATH_INFO: `/v3/users/b4c13c1f32d8478294376df6896c834c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.061566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] RBAC: Authorizing `identity:get_user(user_id=b4c13c1f32d8478294376df6896c834c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:51.063041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769089c5-119a-49da-9fb6-2fc241ed494d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:51.070003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 118/243] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:50 2022] GET /identity/v3/users/b4c13c1f32d8478294376df6896c834c => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:51.071455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.221931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e07a-2c31-4273-9d1d-f1551ddc3676 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.222709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e07a-2c31-4273-9d1d-f1551ddc3676 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.223240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e07a-2c31-4273-9d1d-f1551ddc3676 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.224251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afadf8-e3e3-4519-96d6-299d57cf6e82 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.225111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 119/244] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:51.230555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.230843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.231123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.253869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:51.255067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:51.262165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.262832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.263115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.263390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.330435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:51.335614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:51.337107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413595-c024-4fde-b8ac-5fbf63b64001 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:51.348501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.447170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 126/246] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:51.448880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403aba1-4526-4480-8fd5-b3e99b6bf995 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.448880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403aba1-4526-4480-8fd5-b3e99b6bf995 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.449137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403aba1-4526-4480-8fd5-b3e99b6bf995 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.450637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 127/247] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:51.457484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.457767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.458042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.464942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9324-4c81-4143-bc15-2b38b46f4715 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.474572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:51.475804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:51.503514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.504557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.504985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.505464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.517725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:51.525361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:51.526773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 121/248] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:51.527792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.554626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 128/249] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:51.555649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.631115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1717d-a277-4e85-a245-fe2aaf2aa42e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.655074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550de55-dba7-40c9-8f4c-50340c8e3627 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.665952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.667046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.667496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.667935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.669325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:51.670949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:51.673431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 122/250] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:51.679200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.695444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.696405 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.696828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.697242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.698404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:51.698878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:51.701114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:51.713994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 129/251] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:51.714930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.831499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8839f4c-f4a2-470c-91e1-e53fb247e507 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.850479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0ac-0e10-477a-b736-ba013183fdf6 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.867498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.867498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.867498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.867498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.867914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=b4c13c1f32d8478294376df6896c834c) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:51.867914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:51.867914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:51.870152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 130/252] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/role_assignments?user.id=b4c13c1f32d8478294376df6896c834c&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:51.871251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:51.940193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:51.941279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.941705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.942122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.976567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:51.991500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-b0c66f72-9d51-499c-8418-67659d7ef632 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 07:59:51.992454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7134-6726-4c07-9df4-fbc4cbc34ff4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:51.993279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 123/253] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:51.995049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112988-77d2-430c-b3e0-e1a631dfeb26 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:51.995538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112988-77d2-430c-b3e0-e1a631dfeb26 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:51.995958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112988-77d2-430c-b3e0-e1a631dfeb26 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:51.997405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 124/254] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:52.003692 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.004144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.004569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.033850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.035042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:52.035161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.035616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.036030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] PATH_INFO: `/v3/users/6061c8460476491a970601b0cae8cab2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.037008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:52.037852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] RBAC: Authorizing `identity:get_user(user_id=6061c8460476491a970601b0cae8cab2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.042574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.042719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 131/255] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:51 2022] GET /identity/v3/users/6061c8460476491a970601b0cae8cab2 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:52.043868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.160421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 125/256] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:52.161062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.173356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc12f-b362-42fb-b95b-2e9b49454549 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.227709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.228323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.228610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.228887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.229697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:52.230012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.231400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.240691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 132/257] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:52.241821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.259346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcb816-2293-4dae-bfa2-a99332884611 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.292661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.293527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.293802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.294068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.295255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.296745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.299143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 126/258] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:52.303495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.352703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce0-2ac4-4729-9f72-f5427d8494c9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.388946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.390165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.390655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.391169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.402070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cad00-49e9-4cf8-8a84-d9cced85352c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.404972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:52.412747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 07:59:52.414263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 133/259] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:52.415311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.437058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.437584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.437864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.438129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.439900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.441427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.442982 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 127/260] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:52.443763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.541074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca5deb-62da-4c76-8c61-38fc8be7aeff None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.579891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.579891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.579891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.579891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.580246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:52.580246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.580246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.582627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba56b0-66e8-4c5c-a786-b3bf174a4c3e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.586006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 128/261] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:52.586802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.635143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.636507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.636989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.637478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/6061c8460476491a970601b0cae8cab2/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.644817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, user_id=6061c8460476491a970601b0cae8cab2, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.646637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.685478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650c76b-9dbf-4eb4-8bc5-5309c3119f06 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:52.716541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 134/262] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:52 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/6061c8460476491a970601b0cae8cab2/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:52.717735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.722519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:52.722519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:52.722519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:52.722519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:52.791812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:52.793188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:52.898362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 129/263] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:52.905601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:52.997473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762281-0b5a-4976-9aec-96328df7854e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.076520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.077444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.077735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.078012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] PATH_INFO: `/v3/users/a45e37e4f8a04631b8fc43db6d520956` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.080050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] RBAC: Authorizing `identity:get_user(user_id=a45e37e4f8a04631b8fc43db6d520956)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.081570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.084782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 135/264] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/users/a45e37e4f8a04631b8fc43db6d520956 => generated 283 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:53.089592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:53.205113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0ac0-de87-4fec-9abe-369000d8f5c2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.239989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.240866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.241134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.241408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.242595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.244063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.245926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 130/265] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:52 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:53.256840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:53.289797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05367f-5bc8-4776-a28b-2a6b56294976 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.329895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.329895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.329895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.329895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.382705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de253-e22c-4098-b946-db0a80846a16 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.400241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.401866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.428340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.429001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.429281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.429552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.430385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=a45e37e4f8a04631b8fc43db6d520956) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:53.430691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.432449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.439427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 131/266] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:53 2022] GET /identity/v3/role_assignments?user.id=a45e37e4f8a04631b8fc43db6d520956&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:53.540085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 136/267] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:53.541001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:53.679931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614996-86e7-4c2d-9b16-0566ae5beab3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.718179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.719050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.719330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.719637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.720861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.722312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4b1c-e973-437f-9505-e3d91e829bf2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.724342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 132/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:53 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:53.730409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:53.839244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec6a-3332-4e9f-9e02-e17474170721 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:53.875864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:53.876582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:53.876883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:53.877119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:53.877945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=a45e37e4f8a04631b8fc43db6d520956) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:53.878251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:53.879706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f207-4dc3-43c2-926d-ade0b84738b0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:53.892524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:53 2022] GET /identity/v3/role_assignments?user.id=a45e37e4f8a04631b8fc43db6d520956&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:54.310862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd63e9-880b-468b-87a4-689bc96d8108 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.311214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd63e9-880b-468b-87a4-689bc96d8108 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.311405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd63e9-880b-468b-87a4-689bc96d8108 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.312952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 133/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:54.319053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617394-499b-4564-a332-36a33e861e60 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.319625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617394-499b-4564-a332-36a33e861e60 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.320101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617394-499b-4564-a332-36a33e861e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.337781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a6617394-499b-4564-a332-36a33e861e60 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:54.339415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a6617394-499b-4564-a332-36a33e861e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:54.410594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 138/271] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:54.437634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd63e9-880b-468b-87a4-689bc96d8108 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:54.552384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd63e9-880b-468b-87a4-689bc96d8108 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:54.590669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:54.591496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.591782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.592051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.610110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:54.617456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-08eeb097-9315-45fb-a56d-edd6df9f6223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:54.618918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 134/272] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:54.624990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617394-499b-4564-a332-36a33e861e60 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:54.694740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fac1e-c951-420d-8aa1-9b694c6199d1 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.695216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fac1e-c951-420d-8aa1-9b694c6199d1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.695529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fac1e-c951-420d-8aa1-9b694c6199d1 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.697866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 135/273] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:54.703333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.704783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.705281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.726949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:54.728632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617394-499b-4564-a332-36a33e861e60 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:54.731770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:54.764091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:54.764722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.765005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.765278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.766040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:54.766315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:54.768257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:54.777086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 139/274] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:54.783176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:54.807103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 136/275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:54.832425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:54.881960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2d2b-6871-4e40-a890-9a315c78f18c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:54.915509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:54.916401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.916681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.916955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] PATH_INFO: `/v3/users/0cb34c993a5247cdbaac92dd78c013dd` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.928679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc65d-61d7-433c-9dfb-8ef5e8e14862 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:54.930219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] RBAC: Authorizing `identity:get_user(user_id=0cb34c993a5247cdbaac92dd78c013dd)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:54.931733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd5b4-0709-48ff-b73f-dc624fcf9b61 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:54.933541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 140/276] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:54 2022] GET /identity/v3/users/0cb34c993a5247cdbaac92dd78c013dd => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:54.936834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0d86-5b79-4bef-a790-763fc0cb09b4 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.937118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0d86-5b79-4bef-a790-763fc0cb09b4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.937388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0d86-5b79-4bef-a790-763fc0cb09b4 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.939220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 141/277] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:54.940417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0d86-5b79-4bef-a790-763fc0cb09b4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:54.967952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:54.969042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.969541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.970465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.971738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:54.973173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcc59-83f1-4d88-ab91-b163074d3a36 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:54.975332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 137/278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:54.980795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:54.981086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:54.981363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:54.998594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:54.999784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:55.045340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0d86-5b79-4bef-a790-763fc0cb09b4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.071591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 138/279] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:55.072355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.081262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.082702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.083166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.083806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.085152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, user.id=0cb34c993a5247cdbaac92dd78c013dd, scope.system=all) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:55.085999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.088154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.095863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 142/280] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 12 07:59:54 2022] GET /identity/v3/role_assignments?user.id=0cb34c993a5247cdbaac92dd78c013dd&scope.system=all&role.id=782e17093ca8451595a9135e239dc30b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:55.097116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.210339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c8d1-7527-4058-970c-6c38f00cd983 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.212422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764105e-984f-44d9-ac9f-99201886ac23 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.248001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.248862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.249355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.249789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.257699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.258851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.259303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.260097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.260987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.262939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.263406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:55.271690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:55.273535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:55.279679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.387791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd980d08-1d6b-4da9-b3cc-224b85ed3b55 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.388159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 139/282] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 07:59:55 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 07:59:55.423498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.424236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.424473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.424756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.425565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:55.425880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.427292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.443435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:55.444880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.558803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff6a1-73d1-45ee-8a58-6c82899ce278 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.596367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.597595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.598081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.598612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] PATH_INFO: `/v3/users/b4c13c1f32d8478294376df6896c834c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.600095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] RBAC: Authorizing `identity:get_user(user_id=b4c13c1f32d8478294376df6896c834c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.601772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.603654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:55 2022] GET /identity/v3/users/b4c13c1f32d8478294376df6896c834c => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:55.609517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.711551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa64e-6183-426b-9c7b-e3e09eecaeea None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.744680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.745606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.745892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.746165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.747345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.748862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0476d-12f2-4ef6-a6d3-30a910a475f0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.754012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:55 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:55.758007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:55.861674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0194ab-bd28-46ae-a93b-de413d609758 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.861963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0194ab-bd28-46ae-a93b-de413d609758 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.862165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0194ab-bd28-46ae-a93b-de413d609758 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.863701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 146/286] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:55.865996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7c25-7687-4589-90cf-60e61499180b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:55.868549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.868832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.869109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.886605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:55.887828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:55.907705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:55.909291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:55.909754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:55.910191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/b4c13c1f32d8478294376df6896c834c/roles/42081763a1bd4d9ebd4a01a55f939275` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:55.912917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, user_id=b4c13c1f32d8478294376df6896c834c, role_id=42081763a1bd4d9ebd4a01a55f939275)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:55.915005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:55.960274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 147/287] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:55.985018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:56.017162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 141/288] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 07:59:55 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/users/b4c13c1f32d8478294376df6896c834c/roles/42081763a1bd4d9ebd4a01a55f939275 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:56.097805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff31a-0914-4c92-b311-1b7611c68f2d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:56.145254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:56.146077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:56.146359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:56.146641 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:56.162490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:56.170005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:56.171304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 148/289] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 07:59:56.177963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:56.322483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37e15-d11b-4ef9-89aa-5df39fe769e1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:56.362426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:56.363103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:56.363431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:56.363754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:56.364536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:56.364852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:56.366204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:56.375179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 142/290] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:56.380938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:56.535853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2744-9c5d-4d25-8bf1-b76028cbe4f4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:56.574908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:56.575813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:56.576093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:56.576364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] PATH_INFO: `/v3/users/6061c8460476491a970601b0cae8cab2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:56.577572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] RBAC: Authorizing `identity:get_user(user_id=6061c8460476491a970601b0cae8cab2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:56.579017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:56.581270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 149/291] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:56 2022] GET /identity/v3/users/6061c8460476491a970601b0cae8cab2 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:56.586872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:56.698440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44441f82-1594-4ae7-ad3e-0c9d2aa69d6a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:56.738842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:56.739509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:56.739795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:56.740067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:56.810592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:56.811998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:56.908917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 143/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:56.914702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:57.017377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738acfb-f2dd-4415-8250-05ee06764d66 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:57.051103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:57.052037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:57.052440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:57.052626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:57.053926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:57.055425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82471c28-3e99-4637-809b-b553e18ecfe6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:57.057581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 150/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:56 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:57.064693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:57.163810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d41a0-7c24-4ef1-a410-7868a5d34ab1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:57.202899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:57.203582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:57.203864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:57.204685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:57.205527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=6061c8460476491a970601b0cae8cab2) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:57.205835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:57.207265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2f85-98e5-48c1-b1c2-3e6b063d0783 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:57.213582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 144/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:57 2022] GET /identity/v3/role_assignments?user.id=6061c8460476491a970601b0cae8cab2&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=782e17093ca8451595a9135e239dc30b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:57.789677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425f06-40aa-440b-b25f-a8c4db70c101 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:57.790397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425f06-40aa-440b-b25f-a8c4db70c101 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:57.790397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425f06-40aa-440b-b25f-a8c4db70c101 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:57.791591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 151/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:57.796854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:57.797348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:57.797517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:57.814734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:57.815934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:57.897970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 145/296] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:57.925972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425f06-40aa-440b-b25f-a8c4db70c101 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.042494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425f06-40aa-440b-b25f-a8c4db70c101 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.076086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.076932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.077213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.077524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.088319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:58.095395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 07:59:58.096655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 152/297] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:58.102378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.213345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055de9d-3d43-4911-ae1f-a79bd3d5a17c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.247752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.248429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.248715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.248988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.249743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:58.250109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:58.252086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a0d9b-db10-42c3-b5ce-68dd04e34246 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:58.260624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 146/298] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:58.267585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.372813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfe5d-cf39-46d6-bc37-5c48d1983d4b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.390396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed201-6e92-468f-b450-5cc215798df9 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.390688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed201-6e92-468f-b450-5cc215798df9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.390961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed201-6e92-468f-b450-5cc215798df9 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.392902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 147/299] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 07:59:58.400623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.401244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.401726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.411382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.412298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.412581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.412856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] PATH_INFO: `/v3/users/0cb34c993a5247cdbaac92dd78c013dd` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.414085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] RBAC: Authorizing `identity:get_user(user_id=0cb34c993a5247cdbaac92dd78c013dd)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:58.415578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:58.421909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:58 2022] GET /identity/v3/users/0cb34c993a5247cdbaac92dd78c013dd => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:58.422379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:58.424122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:58.424571 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.511497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 148/301] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:58.528930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.538893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aee2-7c8f-4ec8-a1e2-3bdd925a53b4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.573621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.574529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.574830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.575100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] PATH_INFO: `/v3/system/users/0cb34c993a5247cdbaac92dd78c013dd/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.576695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0cb34c993a5247cdbaac92dd78c013dd, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:58.577976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bec48-a999-4bb3-b6d5-115ad3863904 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:58.631125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef9ea-17fb-499e-98f4-0a64da452572 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.660926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 154/302] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Apr 12 07:59:58 2022] PUT /identity/v3/system/users/0cb34c993a5247cdbaac92dd78c013dd/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 07:59:58.669115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.669115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.669115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.669115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.669399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28ef1-ac6c-442b-b7d8-2d3119d39170 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.669476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:58.669542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28ef1-ac6c-442b-b7d8-2d3119d39170 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.669542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28ef1-ac6c-442b-b7d8-2d3119d39170 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.669680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:58.669749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 155/303] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:58.670299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 149/304] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 07:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:58.675115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9916a-beb1-4960-b445-ba32814e3e51 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.675404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9916a-beb1-4960-b445-ba32814e3e51 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.675710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9916a-beb1-4960-b445-ba32814e3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.684985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.697002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-76c9916a-beb1-4960-b445-ba32814e3e51 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:58.698267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-76c9916a-beb1-4960-b445-ba32814e3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:58.772930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 156/305] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 07:59:58.774082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d8ac-4eca-4f13-af2e-7a6980a017da None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.774627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d8ac-4eca-4f13-af2e-7a6980a017da None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.774901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d8ac-4eca-4f13-af2e-7a6980a017da None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.776376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 157/306] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 07:59:58.785822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.786120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.786521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.806597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 07:59:58.807948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 07:59:58.808645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b9140-47b5-492c-ae2d-46ddb1cd5f47 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:58.844646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:58.845332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:58.845611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:58.845881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] PATH_INFO: `/v3/groups` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:58.846585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:58.848090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:58.877353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 158/307] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 07:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:58.878204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.916812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 150/308] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Apr 12 07:59:58 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 07:59:58.918130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:58.990670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4a0de-e6bc-4f2b-9c6e-108d29df2a68 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.037635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.038454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.038738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.039013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.039274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fca60-0509-4ab3-b7b1-9f16bc680b17 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.053887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:59.063113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:59.065535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 159/309] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:59.071160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.080010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.081008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.081360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.081707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.093538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 07:59:59.102604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 07:59:59.104040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 151/310] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 07:59:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 07:59:59.109886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.183695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedad5-9d61-4b37-8d39-25000071b8c2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.217813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.218741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.219210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.219718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.220604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:59.221054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.222655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.232084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 160/311] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:59.235913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c17d9-631d-4082-8ec7-822d7f2d135d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.238376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.276659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.277330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.277612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.277885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.279037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:59.279351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.281142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.291099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 152/312] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:59.296458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.339805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0345-7c87-4883-ba45-5413568178b8 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.374922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.376698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.377151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.377615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] PATH_INFO: `/v3/users/a6194ba63ba74451a4d9f0687813e6f1` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.392507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] RBAC: Authorizing `identity:get_user(user_id=a6194ba63ba74451a4d9f0687813e6f1)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.394181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.396431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 161/313] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/users/a6194ba63ba74451a4d9f0687813e6f1 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:59.401380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a544-ad72-410a-a941-40cab43f41ac None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.403016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.431356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.432276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.432550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.432804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] PATH_INFO: `/v3/users/b4c13c1f32d8478294376df6896c834c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.434056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] RBAC: Authorizing `identity:get_user(user_id=b4c13c1f32d8478294376df6896c834c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.435439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.442094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 153/314] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/users/b4c13c1f32d8478294376df6896c834c => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:59.443057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.506403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a45617-211a-44dc-a6b6-0d62e96f5199 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.540169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.540824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.541103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.541221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde83a-94d7-4ff0-a40a-a44753eb7a20 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.541404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.542186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, user.id=a6194ba63ba74451a4d9f0687813e6f1, scope.system=all) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 07:59:59.542490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.543964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.549738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 162/315] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/role_assignments?user.id=a6194ba63ba74451a4d9f0687813e6f1&scope.system=all&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 07:59:59.577084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.577753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.578034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.578308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.651236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.652756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.755831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 154/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:59.761346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 07:59:59.863489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95db07-1801-4c7f-9c54-b1d3f90254c4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 07:59:59.897673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 07:59:59.898587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 07:59:59.898864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 07:59:59.899178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 07:59:59.900640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 07:59:59.902076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5d4e3-b1ef-49f2-9fd3-7fb35f7443e4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 07:59:59.904077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 163/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 07:59:59.910392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:00.006450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd9f1-8a6e-4e40-ab13-dd5f91295c1a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:00.040992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:00.041972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:00.042454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:00.042926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:00.043989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2, user.id=b4c13c1f32d8478294376df6896c834c) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:00.044499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:00.046191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d5c4-8dca-41a0-b8ff-2948d95c9920 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:00.052581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 155/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 07:59:59 2022] GET /identity/v3/role_assignments?user.id=b4c13c1f32d8478294376df6896c834c&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:01.038573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1833c-814f-4307-9c8d-3072eeab406c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.039087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1833c-814f-4307-9c8d-3072eeab406c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.039087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1833c-814f-4307-9c8d-3072eeab406c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.040487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 164/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:01.045462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.045844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.046012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.062693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:01.063909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:01.126673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:01.150399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1833c-814f-4307-9c8d-3072eeab406c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.251830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1833c-814f-4307-9c8d-3072eeab406c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.282925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.283756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.284033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.284302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.293937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:01.301421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c04e63bd-7b7a-4f0e-a8af-acbe3ee7a2ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:01.302777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 165/321] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:01.308303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.337961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067ca0-d1ab-4475-bcfe-19838b96d29b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.338257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067ca0-d1ab-4475-bcfe-19838b96d29b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.338515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067ca0-d1ab-4475-bcfe-19838b96d29b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.340060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 166/322] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:01.345300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.345589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.345869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.363171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:01.364398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:01.408652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fbc6c-ba0c-4325-96ba-e962913b2ed0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.429939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 167/323] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:01.441453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.442116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.442403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.442674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.443418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:01.443755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:01.445119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:01.453135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 157/324] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:01.453280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.459781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.550670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0e56f-05cd-497d-a90a-c1339c8d0991 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.557423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190029-95ec-4534-a5a7-ecd6f20f66bd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.585222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.586013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.586298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.586566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.587732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:01.589163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:01.590457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.590908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 168/325] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:01.591410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.591788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.592073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] PATH_INFO: `/v3/users/0cb34c993a5247cdbaac92dd78c013dd` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.593265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] RBAC: Authorizing `identity:get_user(user_id=0cb34c993a5247cdbaac92dd78c013dd)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:01.595247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:01.596642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.601767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 158/326] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:00:01 2022] GET /identity/v3/users/0cb34c993a5247cdbaac92dd78c013dd => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:01.602662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:01.690341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266018-21b0-43d6-b003-92fc916d5ae8 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.696341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aea2d1-ba40-4803-a832-6c625f39cd75 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:01.722784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.723450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.723753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.724021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] PATH_INFO: `/v3/groups` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.724689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:01.726109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2d9ce-01f6-47f8-a15c-e220b0306c27 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:01.728734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:01.729380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.729664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.729941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.731133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] RBAC: Adding query filter params (role.id=782e17093ca8451595a9135e239dc30b, user.id=0cb34c993a5247cdbaac92dd78c013dd, scope.system=all) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:01.731255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:01.732644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3e866-3358-4557-8c0a-8007fa5a1d81 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:01.744102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 159/327] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 12 08:00:01 2022] GET /identity/v3/role_assignments?user.id=0cb34c993a5247cdbaac92dd78c013dd&scope.system=all&role.id=782e17093ca8451595a9135e239dc30b => generated 510 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:01.792084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 169/328] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Apr 12 08:00:01 2022] POST /identity/v3/groups => generated 226 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:00:01.921350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732ffc-ec14-4b0c-a2e8-ba0ee6a0289c None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.921736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732ffc-ec14-4b0c-a2e8-ba0ee6a0289c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.921986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732ffc-ec14-4b0c-a2e8-ba0ee6a0289c None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.923526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 160/329] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:01.930309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:01.930643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:01.930881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:01.949102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:01.950319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:02.020410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 170/330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:02.042478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8732ffc-ec14-4b0c-a2e8-ba0ee6a0289c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:02.143433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8732ffc-ec14-4b0c-a2e8-ba0ee6a0289c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:02.180833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:02.181580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:02.181863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:02.182138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:02.193482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:02.201097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 08:00:02.202594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 161/331] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:02.207977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:02.309190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16e8e8-afa8-419a-bbb3-4591d4966d4d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:02.343613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:02.344332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:02.345186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:02.345460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:02.346253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:02.346563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:02.347975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:02.356964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 171/332] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:02.364000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:02.489330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca9ac-5389-49ac-9eb1-3409749867d9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:02.534901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:02.537512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:02.537950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:02.538371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] PATH_INFO: `/v3/users/a6194ba63ba74451a4d9f0687813e6f1` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:02.540601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] RBAC: Authorizing `identity:get_user(user_id=a6194ba63ba74451a4d9f0687813e6f1)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:02.544397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925e4e-6a75-41b0-8feb-f29cc3a2c691 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:02.546246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 162/333] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:00:02 2022] GET /identity/v3/users/a6194ba63ba74451a4d9f0687813e6f1 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:02.555523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:02.688042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58dbbb-9ae8-4786-9077-4a5056859de2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:02.726802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:02.728021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:02.728453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:02.728868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] PATH_INFO: `/v3/system/users/a6194ba63ba74451a4d9f0687813e6f1/roles/42081763a1bd4d9ebd4a01a55f939275` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:02.730496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6194ba63ba74451a4d9f0687813e6f1, role_id=42081763a1bd4d9ebd4a01a55f939275)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:02.732073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a993c4d-17a8-4d16-9cf9-642f24b91e5c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:02.798285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 172/334] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Apr 12 08:00:02 2022] PUT /identity/v3/system/users/a6194ba63ba74451a4d9f0687813e6f1/roles/42081763a1bd4d9ebd4a01a55f939275 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:04.397546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316a8-313c-4f50-b243-06e009418af5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:04.398572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316a8-313c-4f50-b243-06e009418af5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:04.399054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee316a8-313c-4f50-b243-06e009418af5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:04.401206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 163/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:04.406560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:04.407457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:04.407988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:04.425600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:04.427168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:04.522254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 173/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:04.557853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee316a8-313c-4f50-b243-06e009418af5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:04.666959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee316a8-313c-4f50-b243-06e009418af5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:04.700936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:04.702077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:04.702553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:04.703018 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:04.717906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:04.725415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:04.727204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 164/337] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:04.732703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:04.845807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13259163-a4cd-4ad5-bcbf-866c41221539 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:04.884923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:04.885944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:04.886417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:04.886880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:04.887848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:04.888384 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:04.889951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631a9aa-46ee-423a-b531-bfe2c3f76afe None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:04.900483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 174/338] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:04.906331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.029462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9977d7-fd26-4673-b75b-88905e22f716 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:05.065373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:05.066032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.066316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.066588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.108515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791ad2-1bf3-4dcc-b5b9-42623fcc739c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.109124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791ad2-1bf3-4dcc-b5b9-42623fcc739c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.109593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791ad2-1bf3-4dcc-b5b9-42623fcc739c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.120059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 175/339] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:05.126816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.127100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.127378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.149795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:05.151296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:05.267384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 165/340] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:05.278200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.316514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:05.318271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:05.419878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 176/341] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:05.451004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bcf9-51b5-4e70-9c91-ace862490b63 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:05.490384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:05.491267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.491578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.491851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.493171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:05.494732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:05.496858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 166/342] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:05 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:05.502383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.529171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.633875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb8c7f-9f28-4740-81bc-3ebc1468a50c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:05.676288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:05.677071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.677357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.677623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.694347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:05.695848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3bbb-e707-434a-b7df-242f61a42e86 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:05.697561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 177/343] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:05 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:05.703242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a8c1-64c5-45b2-a37d-6297418d611f None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.703550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a8c1-64c5-45b2-a37d-6297418d611f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.704397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a8c1-64c5-45b2-a37d-6297418d611f None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.705673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 178/344] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:05.712811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a8c1-64c5-45b2-a37d-6297418d611f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.736975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68864-5e16-431d-a749-d0d452be064c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:05.796034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:05.797103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.798081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.798550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.810148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:05.821937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-43441031-145d-43dc-a75c-e7e84e4d26fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:05.823873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 167/345] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:05.825423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.825867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.827461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.846646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:05.848539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:05.914148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a8c1-64c5-45b2-a37d-6297418d611f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:05.945747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 168/346] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:05.946915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:05.951171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:05.952229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:05.952732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:05.953159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:05.954216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:05.954728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:05.956404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:05.964408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 179/347] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:05 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=782e17093ca8451595a9135e239dc30b => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:06.005234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.080895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2890b9-73c7-4415-ab89-9c27affa07d1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.123437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.124155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.124437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.124708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.125519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:06.125835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:06.127234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173fba-be14-4a3d-b217-a4326a4f8b71 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:06.146740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 169/348] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:06.146740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812918-ffe7-469a-8637-070394523f2f None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.147022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812918-ffe7-469a-8637-070394523f2f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.147304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812918-ffe7-469a-8637-070394523f2f None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.152058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 170/349] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:06.153083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10812918-ffe7-469a-8637-070394523f2f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.234740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545964-a5c2-47b0-8a6c-f5b89dd3c561 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.277609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.278436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.278715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.278986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.292453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:06.300654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-986ae99e-2dd3-4a99-8123-c89f27e75f24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:06.307080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 180/350] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:06.308472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.308755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.309030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.320150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10812918-ffe7-469a-8637-070394523f2f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.326078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:06.330241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:06.388711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.391014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.392934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.393470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.442567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 181/351] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:06.449208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.524207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:06.526546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:06.628918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc563c-507f-4aef-90c6-7b7856d19fd9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.684466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 171/352] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:06.687007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.699949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.700952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.701420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.701875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.702805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:06.705526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:06.707143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:06.720275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 182/353] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:06.721418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.829348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0788ab-3be7-443a-962f-c96b0a4abe1b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.862757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.863977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.864445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.864562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91b4db-af96-4719-b372-f423ba3676dd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:06.864997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.866403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:06.868121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:06.870002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 183/354] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:06.870942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.900234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:06.901182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.901574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.902065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.914119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:06.921819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-00440313-5b08-4ae7-bd6a-adf403834fb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:06.923249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 172/355] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:06.924687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f287-571d-447f-a7cd-f5fa5af5ab9a None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:06.925048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f287-571d-447f-a7cd-f5fa5af5ab9a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:06.925393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f287-571d-447f-a7cd-f5fa5af5ab9a None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:06.926745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 173/356] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:06.931550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45f287-571d-447f-a7cd-f5fa5af5ab9a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:06.976555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ffe0-42c9-40a9-b06d-ed8f89530e1a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.010851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.011870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.012340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.012812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.039722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45f287-571d-447f-a7cd-f5fa5af5ab9a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.081744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.082539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.082819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.083092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.084442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.087713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.087713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 174/357] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:07.088320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.104465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.106265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a3468-a96b-49db-97e5-13426a7aebb9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.230541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2787-5699-48f9-81f8-621bbdc24ae9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.254295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 184/358] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:07.254295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.254568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.254773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.271232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:07.272448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:07.275046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.275960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.276428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.276889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.278404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:07.279353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.280933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b259d44-0c37-42ce-b6f8-ec83cb5a142c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.290604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 175/359] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:07.291977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b05b-14e4-48f7-8606-4df1744406f8 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.292266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b05b-14e4-48f7-8606-4df1744406f8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.292542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b05b-14e4-48f7-8606-4df1744406f8 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.294050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 176/360] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:07.294562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b05b-14e4-48f7-8606-4df1744406f8 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.363601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 185/361] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:07.368637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.431981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b05b-14e4-48f7-8606-4df1744406f8 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.480448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.481102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.481378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.481657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.482635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:07.482816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.485713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462d371-04f1-44b2-8140-3b7f80e012c4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.490452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 177/362] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=782e17093ca8451595a9135e239dc30b => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:07.492710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.492999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.493278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.517172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:07.518364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f499-1b34-4faa-b3af-64527c2c88c1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.519356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:07.561995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.562527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.562810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.563663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.566340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.566574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.568653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 186/363] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:07.571997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.618963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:07.620510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.683843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f0a2-51d0-4d49-a5cf-cae7583870b9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.721519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.722486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.722486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.722768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.737660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d008-5e76-459f-981e-2d02bc0e54e2 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.772190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.773354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.773828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.774309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.785406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:07.792391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.793022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 08:00:07.794076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.794786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 179/365] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:07.795781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.896028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361fafa-25b9-4530-b16e-64095fae1b84 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:07.902896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 187/366] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:07.903874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:07.931158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:07.932402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:07.932897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:07.933360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:07.934787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:07.936453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:07.938838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 180/367] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:07.939825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.008281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a92e0-e203-4ec4-906d-2f95a73740c9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.043544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.044372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.044696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.044971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.047060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee641e0-cf6f-4c02-a832-464f12f4e18f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.056021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:08.064704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:08.065841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 188/368] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:08.066695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.082764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.083822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.084301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.084780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.085720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:08.086238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.088123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.096825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 181/369] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.097933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.171406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5f62-ebcb-4b45-9c73-95b95f174984 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.199754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a49d8-1148-4d88-a706-f03976708b8c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.212992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.213911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.214155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.214597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.215854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.217382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.218978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 189/370] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.224150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.237995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.238969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.239455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.239998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.241031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:08.241568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.243188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.249233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 182/371] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.250255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.363779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f8d6f-1904-4898-b1a4-e0a9e683fae5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.369514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5b32-0bf2-4278-89c8-800d0b538aeb None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.402192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.403538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.404078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.404564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] PATH_INFO: `/v3/users/a6194ba63ba74451a4d9f0687813e6f1` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.406062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] RBAC: Authorizing `identity:get_user(user_id=a6194ba63ba74451a4d9f0687813e6f1)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.407840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.409756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 183/372] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/users/a6194ba63ba74451a4d9f0687813e6f1 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.410749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.459443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.460093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.460393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.460657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.461416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:08.461722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.463130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.478694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 190/373] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.481245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.571582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f2b5-5675-4bd5-9cbe-3fbfacefefeb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.640187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.641100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.641559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.641833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.643988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.646155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.647828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 184/374] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.648591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.658555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d6497-759d-47dd-88a2-c9d60d0c9e2e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.727565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.728157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.728433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.728701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.729529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] RBAC: Adding query filter params (role.id=42081763a1bd4d9ebd4a01a55f939275, user.id=a6194ba63ba74451a4d9f0687813e6f1, scope.system=all) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:08.729899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.731387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:08.755139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 191/375] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/role_assignments?user.id=a6194ba63ba74451a4d9f0687813e6f1&scope.system=all&role.id=42081763a1bd4d9ebd4a01a55f939275 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:08.758366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:08.835530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32ab-2907-4e5c-8867-570c2fcf4c47 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:08.874595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:08.875237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:08.875579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:08.875853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:08.965777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:08.967616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.006086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaf39b-a17d-4a2a-8106-e44d85a1c645 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.082098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.082765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.083051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.083324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.084188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:09.084501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.085929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005593c-2afd-4870-ab5b-d0cf6d51a8f6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.096540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 192/376] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 260 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:09.097845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c59b-c8ce-4db2-a3d4-d4243db841d6 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.098137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c59b-c8ce-4db2-a3d4-d4243db841d6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.098418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c59b-c8ce-4db2-a3d4-d4243db841d6 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.099674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 193/377] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:09.102005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 185/378] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:09.105336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.105629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.105905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.107688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.144601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:09.145812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:09.218371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9ec2-e2b0-484c-b352-69abb1f91a7b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.259750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.260594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.260871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.261361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] PATH_INFO: `/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.264066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] RBAC: Authorizing `identity:get_project(project_id=70f2e3c61bc141f3b38a097da3fa11ff)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.265534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.268889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 186/379] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:09.277187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.318777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 194/380] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:09.363741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.430591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5026-c6e8-471d-be37-2551774928c4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.475437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.476757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.477268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.477740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] PATH_INFO: `/v3/groups/9a11e081711f4c14ab17a08be00667ab` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.485207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] RBAC: Authorizing `identity:get_group(group_id=9a11e081711f4c14ab17a08be00667ab)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.486957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.489319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 187/381] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/groups/9a11e081711f4c14ab17a08be00667ab => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:09.495656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.506946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523cd7-a124-471c-bf8c-a55e2984c20e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.578123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.579382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.579699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.579972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.607143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:09.609502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6651-f528-4140-8304-048cc84ef3a4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.617049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:09.618586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 195/382] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:09.624186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.647870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.650066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.650553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.651066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.652154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] RBAC: Adding query filter params (group.id=9a11e081711f4c14ab17a08be00667ab, role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=70f2e3c61bc141f3b38a097da3fa11ff) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:09.652690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.654514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.663859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 188/383] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/role_assignments?group.id=9a11e081711f4c14ab17a08be00667ab&scope.project.id=70f2e3c61bc141f3b38a097da3fa11ff&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:09.751559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cdb6f-d916-401e-8326-3d090f1d658b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.788868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.789949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.790439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.790913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.792081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:09.792607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.794235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.804507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 196/384] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:09.811310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:09.921314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566980b-41ca-4e89-936b-069f86a4f829 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:09.962266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:09.963496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:09.963999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:09.964469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:09.968240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:09.970488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:09.972394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 189/385] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:09.978245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:10.096109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227fc5-0102-40c1-a318-09d81d9d42be None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:10.132187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:10.133056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.133334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.133600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.134778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:10.136371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cd46-f9c2-41a1-95d9-82c51b712873 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:10.138360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 197/386] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:09 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:10.148507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:10.297946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd196456-82a1-46ff-8d69-6a51e8bc496b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:10.334906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:10.335107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.335366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.335670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.338480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, group_id=c32f4c8570e04a27b2fc88ec52195dd9, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:10.341453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:10.403037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb5cc-3331-4a8d-a714-b3dd5d5486e4 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.403319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb5cc-3331-4a8d-a714-b3dd5d5486e4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.403625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb5cc-3331-4a8d-a714-b3dd5d5486e4 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.405295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 198/387] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:10.411944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.412277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.412561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.430360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 190/388] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 12 08:00:10 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:10.437294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:10.438530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:10.530003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 199/389] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:10.566172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:10.669901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b483f9c-a2db-4e02-a9f8-80d5c966156b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:10.718194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:10.718914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.719225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.719595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.731083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:10.738584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:10.740190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 191/390] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:10.746780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:10.851783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d897-e65d-43d1-98b6-12ba3d9d9484 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:10.893529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:10.894216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:10.894497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:10.894771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:10.895549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:10.895860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:10.897239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:10.906150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 200/391] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:10.913113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.020845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9b17-e1f3-4a61-a644-17fc67a058e4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:11.066664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:11.067551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.067840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.068114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.070859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:11.072322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:11.074237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 192/392] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:10 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:11.080197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.190935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50694-a267-4ffb-99b2-fd4a2a6fe8b0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:11.236629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:11.237678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.237807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.238133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.239331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:11.240795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65c74-6770-4925-ac96-c8cc31b4cec9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:11.242763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 201/393] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:11 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:11.248485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.309748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e8d6-3119-4798-a7a2-c831161b56c2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.310025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e8d6-3119-4798-a7a2-c831161b56c2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.310225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e8d6-3119-4798-a7a2-c831161b56c2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.311934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 202/394] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:11.319401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9409-d355-46a0-8464-273abf59e820 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.319713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9409-d355-46a0-8464-273abf59e820 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.319986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9409-d355-46a0-8464-273abf59e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.347276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-407e9409-d355-46a0-8464-273abf59e820 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:11.348486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-407e9409-d355-46a0-8464-273abf59e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:11.410476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce26d2-45df-49a5-a599-1457f014ac19 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:11.473213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 203/395] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:11.475206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:11.476125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.476404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.476678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.478629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, group_id=c32f4c8570e04a27b2fc88ec52195dd9, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:11.480086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:11.498441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e9409-d355-46a0-8464-273abf59e820 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.548148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 193/396] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 12 08:00:11 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:11.625814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e9409-d355-46a0-8464-273abf59e820 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:11.671546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:11.672957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.673237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.673511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.688514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:11.696220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:11.697821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 204/397] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:11.704198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.820600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550aeef-5c09-47f6-a98a-fbc587b93d08 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:11.863030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:11.863726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:11.864120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:11.864401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:11.865153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:11.865463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:11.866841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:11.880727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 194/398] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:11.885651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:11.999336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf782fc-a55a-465a-a1a9-e1a53718ce64 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:12.037681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:12.038578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.038914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.039241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.040687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:12.042112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:12.044278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 205/399] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:11 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:12.050507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:12.202215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4986b6-cf81-46bb-b87c-26565f830850 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:12.243035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:12.243924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.244204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.244476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.248194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:12.249641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9470e0e-3027-446d-bbc9-ce7420744205 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:12.252258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 195/400] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:12 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:12.257689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:12.403302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d8e3-6f3f-4fb7-a71f-88f1f17faef8 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:12.448719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:12.449946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.450449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.450919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.453964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=72159ee49daf46efbb8b01b3dc692e5c, group_id=c32f4c8570e04a27b2fc88ec52195dd9, role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:12.459668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:12.483604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0d7f7-9d03-4bc3-bbc1-6bc22d2b308d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.483914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0d7f7-9d03-4bc3-bbc1-6bc22d2b308d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.484175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0d7f7-9d03-4bc3-bbc1-6bc22d2b308d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.486451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 196/401] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:12.492945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.493233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.493506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.512935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:12.514267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:12.555643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 206/402] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 12 08:00:12 2022] PUT /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:12.595647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 197/403] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:12.640150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:12.772834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cd1cb-3d46-458a-8578-a7da91364f1b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:12.810937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:12.812185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.812734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.813208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.824736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:12.833071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-769aa5a1-9c96-4ab9-bad6-30f3cbfc3f8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:12.834821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 207/404] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:12.840664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:12.909352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2d28-f0f5-4140-9cfc-fe38602c25dc None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.910300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2d28-f0f5-4140-9cfc-fe38602c25dc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.910784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2d28-f0f5-4140-9cfc-fe38602c25dc None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.912678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 208/405] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:12.917859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:12.918385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:12.918900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:12.939108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:12.940826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:13.018976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 209/406] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:13.035316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162e5f-729a-4f35-8013-903667cf5a65 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.045443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.098286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.099020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.099308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.099606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.100368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:13.100936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.102049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.118874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 198/407] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:13.138483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.170869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2aba49-a04d-4e0e-85e0-210ac61e65d0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.225677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.226875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.227372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.227869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.239721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:13.247849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:13.249834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 210/408] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:13.256984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.365971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6f5f-59fe-48c4-811e-0e83ec4db156 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.410317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.411386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.411905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.412953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.414074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:13.414590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.416349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.427089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 211/409] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:13.431657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cacf6-2c87-4683-928e-dbea19904714 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.435426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.520724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.521592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.521920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.522141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.528168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.529621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.535522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 199/410] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:13.536963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.554266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396ecc-ed8d-450e-92fb-48b396ddd51d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.613083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.614326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.614852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.615312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] PATH_INFO: `/v3/groups/9a11e081711f4c14ab17a08be00667ab` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.619394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] RBAC: Authorizing `identity:get_group(group_id=9a11e081711f4c14ab17a08be00667ab)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.621079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.623246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 212/411] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/groups/9a11e081711f4c14ab17a08be00667ab => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:13.628729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.648041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029814c-1ad4-4056-b3a6-d49eeee6ae19 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.682825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.691510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 200/412] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:13.694963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.804303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0b47-71b8-4a56-b9ac-e7372f248542 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.835506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05666130-e9c4-4faa-890e-93ffad646c36 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.845538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.847272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.847582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.847861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] PATH_INFO: `/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.849629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] RBAC: Authorizing `identity:get_project(project_id=70f2e3c61bc141f3b38a097da3fa11ff)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.851349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1aa0b-40f8-4665-981c-360af53cb63c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.853863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 213/413] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:13 2022] GET /identity/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:13.860329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71ff1-4e56-4e0b-98f4-a0fc8dd2d831 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.860719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71ff1-4e56-4e0b-98f4-a0fc8dd2d831 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.861015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71ff1-4e56-4e0b-98f4-a0fc8dd2d831 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.862352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 214/414] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:13.863060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71ff1-4e56-4e0b-98f4-a0fc8dd2d831 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:13.870567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:13.871382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.871685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.871963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.874234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3c6a292efd54d2ea61c4853875bfac2, group_id=c32f4c8570e04a27b2fc88ec52195dd9, role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:13.875804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281919b-557e-41c3-892b-a00623e1aca6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:13.952335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 201/415] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 12 08:00:13 2022] PUT /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2/groups/c32f4c8570e04a27b2fc88ec52195dd9/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:00:13.954551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:13.954849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:13.955128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:13.992395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:13.994960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71ff1-4e56-4e0b-98f4-a0fc8dd2d831 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:13.995757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:14.069774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.070691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.070973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.071247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] PATH_INFO: `/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff/groups/9a11e081711f4c14ab17a08be00667ab/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.074243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] RBAC: Authorizing `identity:create_grant(project_id=70f2e3c61bc141f3b38a097da3fa11ff, group_id=9a11e081711f4c14ab17a08be00667ab, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:14.075767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:14.118024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 202/416] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:14.143785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.151118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 215/417] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 12 08:00:13 2022] PUT /identity/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff/groups/9a11e081711f4c14ab17a08be00667ab/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:14.296478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41eb73-e8f1-4a6d-81ad-f6d5267a609d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:14.347371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.348220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.348506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.348784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.367118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:14.374435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-90d16898-14a4-4939-ad6a-3901f1deaf74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:14.380622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 203/418] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:14.386501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.450597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2986e6-052d-477a-b947-85e264665e6f None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.450881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2986e6-052d-477a-b947-85e264665e6f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.451071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2986e6-052d-477a-b947-85e264665e6f None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.452792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 204/419] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:14.458105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.458397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.458682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.478710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:14.479944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:14.496246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35be9c-099e-4146-9f33-7752b3b00391 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:14.531215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.532457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.532742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.533024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.533774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:14.534085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:14.535642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:14.544426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 216/420] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:14.558173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.559285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 205/421] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:14.595708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.660796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422e1d-8970-47fa-87f2-64971cb7aa32 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:14.695347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.695347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.697846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.697846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.738877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363390b-6938-48f1-a4b0-36807b502267 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:14.764696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:14.766250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:14.782092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.783330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.783831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.784297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.808292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:14.824433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 08:00:14.826349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 206/422] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:14.832073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.872953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 217/423] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:14.879529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:14.946895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca2fe-3ea7-436b-af6e-1eac9323f59e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:14.994109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:14.994878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:14.995254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:14.995654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:14.996525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] RBAC: Adding query filter params (name=member) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:14.996932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:14.998355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.013826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def9013-360b-49a1-9209-bf31c29ba6f7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.014354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 207/424] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:15.020237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.050818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.052082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.052566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.054400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.055900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.057604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.060148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 218/425] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:14 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:15.065177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.136295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d49f4-9b61-4916-89ce-75b03b16f83e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.174674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.175325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.175625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.175900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.284175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04121e-b92e-4e3e-8c06-d451aff5b9f1 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.309108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.310573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9facb5-15a2-47f8-8ab0-02bd48ce9b28 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.350479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.351340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.351647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.351917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.353880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.355330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.356965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 219/426] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:15.363701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.467765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 208/427] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 08:00:15.469457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8604-5566-42c1-bdb7-d5f91629a3b3 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.470011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8604-5566-42c1-bdb7-d5f91629a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.470314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8604-5566-42c1-bdb7-d5f91629a3b3 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.476080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 209/428] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:15.476862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db8604-5566-42c1-bdb7-d5f91629a3b3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.488087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8a8c-43ae-4ec3-a3b5-0398f186dd6c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.531868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.532540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.532824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.533100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.533933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:15.534301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.536446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a15a98-1e7c-4eae-a049-d19976923686 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.544865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 220/429] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=782e17093ca8451595a9135e239dc30b => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:15.546153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.546600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.547427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.569881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:15.571770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:15.593220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db8604-5566-42c1-bdb7-d5f91629a3b3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.630103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.631007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.631290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.631602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.632791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.634263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.636026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 210/430] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:15.642164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.666219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 221/431] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:15.715856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.826522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf163-4f0c-4abe-8790-d24a1268b981 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.837692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8371b5-60b5-4629-968e-34e687651e56 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:15.867261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.869048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.869553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.870132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.872194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:15.873887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:15.876689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 211/432] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:15.880921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:15.880921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:15.880921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:15.880921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:15.882855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:15.896939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:15.905243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:15.906816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 222/433] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:15.913278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.016585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bf3b0-07ae-4b2a-8e18-f2e413c0f2a3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.049382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd19bd-7276-4880-8d25-ff2d6e0b5358 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.053989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.054912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.055339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.055803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.056783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=782e17093ca8451595a9135e239dc30b, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:16.057264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.059825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.067032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 212/434] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=782e17093ca8451595a9135e239dc30b => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:16.098461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.099461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.099953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.100432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.101463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:16.102012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.103673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.114553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 223/435] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:16.120342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.259607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18aa76-3955-435b-b08c-8d37b3b58d98 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.298677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.299653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.300138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.300590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.369457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.371198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.488028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 213/436] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:16.493780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.602985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd31f3-a436-4b02-988c-8dab5ae15faf None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.634675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.635460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.635763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.636037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] PATH_INFO: `/v3/projects/72159ee49daf46efbb8b01b3dc692e5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.637218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] RBAC: Authorizing `identity:get_project(project_id=72159ee49daf46efbb8b01b3dc692e5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.638635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.640528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 224/437] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:16 2022] GET /identity/v3/projects/72159ee49daf46efbb8b01b3dc692e5c => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:16.646476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.738596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b295f3-e0d5-4d44-9d66-4ec502940947 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.770617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.771466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.771769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.772043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.773198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.774877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcf0bc-f07b-4ed5-82d5-daf77559fd13 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.776665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 214/438] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:16 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:16.782149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.813495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec68d8-cba1-4997-a431-299cc0ca5685 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.813838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec68d8-cba1-4997-a431-299cc0ca5685 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.814054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec68d8-cba1-4997-a431-299cc0ca5685 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.815569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 215/439] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:16.820425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.820718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.821004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.838141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:16.839341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:16.878540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640438-ce6e-45d9-8c9d-2e6fa7372499 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:16.906945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 216/440] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:16.912082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:16.912730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.913008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.913277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.914094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=72159ee49daf46efbb8b01b3dc692e5c) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:16.914401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:16.915863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5136-e87d-43b5-8415-77fb608aee0d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:16.921640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 225/441] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:16 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=72159ee49daf46efbb8b01b3dc692e5c&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:16.931024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:16.958504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b1ad-424f-45ea-9ce6-7ac22096fdfd None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.958849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b1ad-424f-45ea-9ce6-7ac22096fdfd None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.959067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b1ad-424f-45ea-9ce6-7ac22096fdfd None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.960645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 226/442] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:16.966155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:16.966440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:16.966717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:16.983749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:16.985658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:17.038533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bdf8c-c82f-4776-bd75-ce6da3ad12e8 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.069974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 227/443] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:17.075640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.076747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.077228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.077712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.089854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:17.095081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.098504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:17.099908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 217/444] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:17.105665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.209283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e4c0-375a-4a4d-911c-91edb016b0ec None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.225176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09a173-30a9-43ee-adc1-ee4c010cd7e1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.252668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.252668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.252943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.253197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.262852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.263547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.263830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.263995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:17.264109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.264862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:17.265952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.267285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.270907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:17.273281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 228/445] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:17.275121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 218/446] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:17.279078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.280464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.388366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609365a-e3fe-45fe-be90-85c3022131c2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.391637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172635ea-8d9c-4bb1-a8ee-e9a1fc2bd876 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.424273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.424606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.425545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.425545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.425896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:17.427134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.427595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.432385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.433038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.433444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.433619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.436128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 229/447] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:17.441755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.505044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.506494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.537674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343915b9-9c2d-4a15-a61c-edc407ea96a4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.573217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.573864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.574148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.574421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.599856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 219/448] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 08:00:17.605457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.638567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.640059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.696288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8a09a-5cc1-4357-8254-f23e322354d1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.727810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.728678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.728965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.729239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] PATH_INFO: `/v3/projects/f3c6a292efd54d2ea61c4853875bfac2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.730406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] RBAC: Authorizing `identity:get_project(project_id=f3c6a292efd54d2ea61c4853875bfac2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.731044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 230/449] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 08:00:17.732025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.735882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 220/450] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/projects/f3c6a292efd54d2ea61c4853875bfac2 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:17.738000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.739374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.833249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c30aba-fd03-4805-9c40-51a98b94724f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.833462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dbf3b-fc21-4f1c-8d57-71b0647e6786 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.866558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.867408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.867714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.867990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] PATH_INFO: `/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.869149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] RBAC: Authorizing `identity:get_group(group_id=c32f4c8570e04a27b2fc88ec52195dd9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.870584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.870917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:17.871810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:17.872093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:17.872221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 221/451] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/groups/c32f4c8570e04a27b2fc88ec52195dd9 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:17.872369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] PATH_INFO: `/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:17.873542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] RBAC: Authorizing `identity:get_project(project_id=70f2e3c61bc141f3b38a097da3fa11ff)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:17.875663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:17.877449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 231/452] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/projects/70f2e3c61bc141f3b38a097da3fa11ff => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:17.878638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.882368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:17.970358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397772b-7fc4-4728-ad94-ed40d0c189a3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:17.974439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529a5b7-f455-44a9-a357-0850b7c2b31d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:18.001369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:18.002116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:18.002405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:18.002681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:18.003530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] RBAC: Adding query filter params (group.id=c32f4c8570e04a27b2fc88ec52195dd9, role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=f3c6a292efd54d2ea61c4853875bfac2) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:18.003845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:18.005255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2ab51-9913-4e7b-a20c-fc5c25c71b02 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:18.005349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:18.006116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:18.006395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:18.006669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] PATH_INFO: `/v3/groups/9a11e081711f4c14ab17a08be00667ab` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:18.007847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] RBAC: Authorizing `identity:get_group(group_id=9a11e081711f4c14ab17a08be00667ab)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:18.009259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:18.010848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 232/453] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/groups/9a11e081711f4c14ab17a08be00667ab => generated 229 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:18.011172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 222/454] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:17 2022] GET /identity/v3/role_assignments?group.id=c32f4c8570e04a27b2fc88ec52195dd9&scope.project.id=f3c6a292efd54d2ea61c4853875bfac2&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:18.017561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:18.118933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6307a-57ee-4ea3-81b8-52b5d292a929 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:18.157410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:18.158078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:18.158360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:18.158637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:18.159504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] RBAC: Adding query filter params (group.id=9a11e081711f4c14ab17a08be00667ab, role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=70f2e3c61bc141f3b38a097da3fa11ff) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:18.159815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:18.161271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec3f8-6a6e-400d-9725-87069822ff39 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:18.167716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 233/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 12 08:00:18 2022] GET /identity/v3/role_assignments?group.id=9a11e081711f4c14ab17a08be00667ab&scope.project.id=70f2e3c61bc141f3b38a097da3fa11ff&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:20.941745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd709-b48b-42dd-8638-beb484891c17 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:20.942258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd709-b48b-42dd-8638-beb484891c17 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:20.942356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd709-b48b-42dd-8638-beb484891c17 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:20.943907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 223/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:20.961478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525429-211c-4966-ba38-cd401e830eeb None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:20.961970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525429-211c-4966-ba38-cd401e830eeb None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:20.962043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525429-211c-4966-ba38-cd401e830eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:20.985580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-65525429-211c-4966-ba38-cd401e830eeb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:20.986804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-65525429-211c-4966-ba38-cd401e830eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:21.073775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 234/457] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:21.116625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd709-b48b-42dd-8638-beb484891c17 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.259024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd709-b48b-42dd-8638-beb484891c17 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.291540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f213c-0210-45f0-8b08-58462e77a64b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.291839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f213c-0210-45f0-8b08-58462e77a64b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.292102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f213c-0210-45f0-8b08-58462e77a64b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.293701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 235/458] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:21.301027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.301623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.302100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.316020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.316834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.317119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.317394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.322760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:21.324677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:21.331182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.332674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.358742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:21.360588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 224/459] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:21.366830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.405697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:21.434341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.548959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f8f4-2bfd-4294-b347-3ee1099f706d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.586331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.587581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.588169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.588642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.595120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9bc7d-4263-421c-ab96-9661106f8dd9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.601150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.602867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.622591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0c6ad57c-882b-4490-ac35-5e4d1c14df12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:21.630392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 237/461] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:21.632023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135161-d435-4ca8-8729-a2c6201c7a37 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.632514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135161-d435-4ca8-8729-a2c6201c7a37 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.632987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135161-d435-4ca8-8729-a2c6201c7a37 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.634774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 238/462] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:21.635692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6135161-d435-4ca8-8729-a2c6201c7a37 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.645495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.646436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.646890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.647346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.648254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:21.648729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.650603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236405c7-da16-48c1-b03b-44e4b42c16ef None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.668948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 225/463] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:21.670576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.671174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.672233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.689446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:21.690943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:21.746072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6135161-d435-4ca8-8729-a2c6201c7a37 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.760199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 226/464] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:21.761287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.793257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.794098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.794441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.794726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.795536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:21.795838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.797772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ef14-85a7-43f4-9e81-684b41e0c433 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.809092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 239/465] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:21.810376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871683-ca9d-4563-a3f5-020bc411c8de None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.810666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871683-ca9d-4563-a3f5-020bc411c8de None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.810942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871683-ca9d-4563-a3f5-020bc411c8de None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.815513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 240/466] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:21.815513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871683-ca9d-4563-a3f5-020bc411c8de None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:21.866226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438266-989c-46f8-9c3c-ce960b42a802 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.898937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.899915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.900200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.900484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.901185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.902752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879cb0-53bb-402b-9c1d-897974505b38 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.919300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871683-ca9d-4563-a3f5-020bc411c8de None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:21.951713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:21.952500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:21.952795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:21.953083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:21.962939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:21.964405 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:21.981312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:21.982821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 241/467] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:21.983338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.007947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 227/468] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:21 2022] POST /identity/v3/users => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:22.009218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.009508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.009784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.032560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:22.033966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:22.090715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838303b-4b52-4daf-bbc2-9b01c699e179 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.106563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 228/469] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:22.107426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.128176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.129161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.129626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.130123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.131039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.132766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb860d-5424-41c1-a757-ea45a02b83bf None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.213591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 242/470] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:21 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:22.213800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29f6a9-e3a4-4723-b568-c170991444ea None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.213888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f877c3-3a62-47ae-9431-3dcda9d98160 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.213888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f877c3-3a62-47ae-9431-3dcda9d98160 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.213888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f877c3-3a62-47ae-9431-3dcda9d98160 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.213888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 243/471] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:22.214481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f877c3-3a62-47ae-9431-3dcda9d98160 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.256653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.257337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.257644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.257918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.258657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:22.258968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.260416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0063-b4d0-47cc-a20c-9dc374fd1a07 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.279091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 229/472] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:22.280830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.281348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.281924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.302932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:22.304603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:22.339978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f877c3-3a62-47ae-9431-3dcda9d98160 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.379071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.380601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.380888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.381164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.389777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 230/473] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:22.391025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.402351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.403846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.422795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:22.424341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 244/474] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:22.425153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.507298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9a8f-9569-4424-9127-38e18c5a8080 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.532790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f68f1-cbd1-4817-9ba9-008af5b6f300 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.542266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.542942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.543226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.543529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.544286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.545690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.571773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.572439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.572766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.573041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.573772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.575126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.612941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.sql.core [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 12 08:00:22.612941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 12 08:00:22.612941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [parameters: {'id': 'a611d60b52784f42a27ea528519e526c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 12 08:00:22.612941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80256) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 08:00:22.627951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 12 08:00:22.629697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 245/475] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 12 08:00:22 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:22.630659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.638341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 231/476] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:22 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:22.647510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.747729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7562-be19-4a11-becd-fa7f12d91141 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.798806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.799995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.801457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.802040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.803875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:22.804575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:22.808653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:22.833443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 246/477] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:22.839751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.843772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ef788-891a-41a6-98f4-d7fe4d720d6a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:22.913206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:22.914458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:22.914935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:22.916293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:22.936319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:22.950148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 08:00:22.956262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 232/478] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:00:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:22.961740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:22.995517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29c29-4e04-4b05-be91-7a0b1f1cf783 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:23.026333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:23.027017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:23.027304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:23.027622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:23.028336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:23.029778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506dcd-774d-4a56-ba20-cdc5d127843f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:23.067698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132cdd8-e89b-4e29-86a2-9a00dd2a5e8c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:23.102192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:23.102867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:23.103162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:23.103644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:23.104411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:23.104725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:23.106128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a9572-5225-4e63-93a0-e25a03102ea1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:23.115397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 233/479] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:23.145451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 247/480] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:22 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:24.686790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ff83-05a7-49ae-af36-22695ac9b7fb None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:24.687891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ff83-05a7-49ae-af36-22695ac9b7fb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:24.687973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ff83-05a7-49ae-af36-22695ac9b7fb None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:24.689629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 234/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:24.695559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131cd1-8e04-4a5b-aa10-717e29a5eb44 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:24.695997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131cd1-8e04-4a5b-aa10-717e29a5eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:24.696120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131cd1-8e04-4a5b-aa10-717e29a5eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:24.717101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-99131cd1-8e04-4a5b-aa10-717e29a5eb44 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:24.718331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-99131cd1-8e04-4a5b-aa10-717e29a5eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:24.801791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 248/482] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:24.848910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1ff83-05a7-49ae-af36-22695ac9b7fb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:24.890048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fafaf-a3db-4eb8-8b01-2209a35e93ed None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:24.890913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fafaf-a3db-4eb8-8b01-2209a35e93ed None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:24.891171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fafaf-a3db-4eb8-8b01-2209a35e93ed None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:24.892873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 249/483] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:24.897956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:24.898504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:24.898977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:24.932524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:24.933730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:24.970021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1ff83-05a7-49ae-af36-22695ac9b7fb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.035866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.036673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.036958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.037234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.056906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 250/484] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:25.057543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:25.065462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:25.066934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 235/485] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:25.072588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.083919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.184035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662788-2290-41a1-b010-5162f3daf7de None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.221789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4bfd-3d92-41b7-8409-39588e663b69 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.226278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.227140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.227590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.228044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.229450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:25.229997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:25.232867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:25.260504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 251/486] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:25.264694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.270146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.270969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.271257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.271560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.295297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:25.303843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:25.305678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 236/487] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:25.312478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.389725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946927f6-9803-493a-a638-5ac2cc067d29 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.427998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.430318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.431710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.432269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.456125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:25.458661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:25.485514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:25.487373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 252/488] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:25.491637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d65cc-8f00-4a6b-9db8-94b6ae5929f3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.499176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.560177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.561248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.561731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.562267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.563223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:25.564374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:25.566114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:25.585193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 237/489] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:25.590111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.694264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cda00-e9f6-4699-95fb-c6ab947b376e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.742012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2fd63-2524-441e-8c92-378a34c129d3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.776176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.776865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.777127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.777402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.778122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:25.778427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:25.779817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:25.780801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:25.781826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:25.782299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:25.782765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:25.801882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:25.803955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:25.806048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 253/490] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:25.813516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.841554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:25.851713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 238/491] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:25.854012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:25.969246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25351c-a59c-4128-a957-14fa2ac16c69 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:25.970270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a8fa-2ccf-4be9-bdaa-90ba430fe6dc None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.003141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.003323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.003890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.004002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.004172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.004263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.004448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.004539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.005178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:26.005486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.006853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e23d-93a0-4444-ae95-d5a3392f4b94 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.011984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.013591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.018565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 239/492] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:26.020130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ba79-4468-44ac-b92c-6a12c34baaf2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.020580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ba79-4468-44ac-b92c-6a12c34baaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.021016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ba79-4468-44ac-b92c-6a12c34baaf2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.022427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 240/493] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:26.023960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14239-7088-4a8e-9289-05660d801b60 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.024244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14239-7088-4a8e-9289-05660d801b60 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.024835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14239-7088-4a8e-9289-05660d801b60 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.026156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 241/494] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:26.026872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb14239-7088-4a8e-9289-05660d801b60 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.035278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-a429921a-77ca-4f0e-9d65-76e4e74f3b5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:26.039500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 254/495] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:26.039500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257a03-017f-4905-ac39-e98e77f403ce None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.039500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257a03-017f-4905-ac39-e98e77f403ce None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.039500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a257a03-017f-4905-ac39-e98e77f403ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.055729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-1a257a03-017f-4905-ac39-e98e77f403ce None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:26.056900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1a257a03-017f-4905-ac39-e98e77f403ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:26.130710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 255/496] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:26.132238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb14239-7088-4a8e-9289-05660d801b60 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.132548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.133016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.133444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.150721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:26.152211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:26.179754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.180690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.181069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.181350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.192259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.193719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.211134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 08:00:26.212406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 242/497] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:26.213371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.224233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 256/498] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:26.225675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.316845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d51a3-675a-4336-92ad-5387aedbde17 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.331280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb228ed-88d9-4fa8-944e-8aa5f3a92aa1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.356371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.357031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.357312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.357587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.358417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:26.358726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.360774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.367803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.368597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.368880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.369156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.378908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:26.386005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:26.387180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 257/499] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:26.387965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.400268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 243/500] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:26.400268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.479552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102000d3-025c-4d24-8ab6-3a7cdb93d30c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.490324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b72ad1-13e8-458f-995a-ad60360cb1df None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.510249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.510901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.511180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.511449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.512301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:26.512607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.514035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba4ffc-648d-4475-b417-230825089ad3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.520971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.521745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.522027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.522297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.532947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.534383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.549866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 258/501] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:26.550749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:26.551118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047637d-3e7c-4584-8b5b-cf4444c95a30 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.551403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047637d-3e7c-4584-8b5b-cf4444c95a30 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.551705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047637d-3e7c-4584-8b5b-cf4444c95a30 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.556676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 244/502] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:26.556676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.556879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 259/503] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:26.556879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047637d-3e7c-4584-8b5b-cf4444c95a30 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.649555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ad9d-a443-42f3-9a84-4994401f3a73 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.650941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047637d-3e7c-4584-8b5b-cf4444c95a30 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.681730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.682382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.682662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.682930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.683058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.683701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:26.683797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.683988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.684090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.684287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.685372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.693124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 245/504] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:26.693740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.746344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.747813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.788416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b96e-03a5-42a6-a318-9a9f52fae684 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.818722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.819345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.819654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.819930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.838001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 260/505] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:26.838001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.881640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.883099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cb8c6-fde8-4b3d-b404-a4827ff19207 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.933799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c795-ccf2-425d-a271-bffbacca64d6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:26.965428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:26.966078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.966358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.966632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.967343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:26.967678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:26.969587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:26.976732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 246/506] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:26.977992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:26.978280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:26.978556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:26.984367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 261/507] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:26.984367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:26.997537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:26.998708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:27.059675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 247/508] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:27.060483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.076611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801ad4-c2c2-497f-a001-a00acc6b5b5e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.109498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.110287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.110568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.110840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.120837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.122281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.138547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:27.139732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 262/509] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.141081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.153900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8d1a1-dc92-4b7c-b963-ce35b8fa76db None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.189089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.189875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.190153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.190424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.200114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.201554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.218134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:27.219315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 248/510] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.220084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.234240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e095-a698-4b09-aaeb-0f78f0f52434 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.269833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.270624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.270910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.271184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.282171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.283645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.300471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:27.301646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 263/511] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.302417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.315860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77e0b7-ff3e-4368-95d8-226ec1ec688a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.349800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.350461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.350738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.351014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.351740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.353168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.398046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0839a-e6ce-4732-9be1-3742b222cee5 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.429674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 249/512] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:27 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:27.429985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.430476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.430799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.431117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.431425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.442956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:27.450186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:27.451667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 264/513] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.452290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.550290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5a4c9-597e-4f40-bbc3-7593ef723373 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.556476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d8d6-eac6-4e9d-81ca-63de90f1cdcf None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.585576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.586249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.586531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.586803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.587593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:27.587978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.589325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.591218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.591929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.592216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.592492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.593865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:27.594182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.595665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.602694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 250/514] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:27.603578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.609764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 265/515] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:27.611647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.710731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeebd4e-e385-4a56-b56a-3d4ba8654f30 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.715655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bee10-d446-4318-ba69-7a6722bcd858 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.743293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.743986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.744267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.744541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.745258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:27.745563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.746942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.748616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.749249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.749553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.749825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.750555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:27.750857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.752233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.758154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 251/516] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:27.758968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.764701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 266/517] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:27.766349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.857700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dca83d-ce1d-4514-8c5f-c1c5c8e46195 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.864845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908ef7e-08ed-4da0-9136-843e2d7c77d9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:27.891378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.892404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.892828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.893242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.897722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:27.898508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:27.898789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:27.899063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:27.903048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.904685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.905802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:27.907506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:27.918227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 08:00:27.923788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 252/518] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.923788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:27.924019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:27.926129 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 267/519] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:27.926827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.014014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f8ec2-b648-4fc9-ab37-565f2779e8f6 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.022433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079fd9-9c1f-44b7-ae28-e7fedc412268 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.046612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.047675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.048148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.048591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.055276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.057119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.057412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.058194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.058473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.058746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.068727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.070133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.071016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:28.077119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 253/520] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:28.077119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.092744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:28.098353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 268/521] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:28.098353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.174391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407fda-4978-4584-b0c7-77e6e3f09934 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.198169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e5f95-7630-42cd-9fde-eb1fda46b506 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.211224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.211943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.212234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.212511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.213380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.213695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.215213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.231596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.237143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 254/522] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.237295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.237295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.237295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.237481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.237552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.237552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.237552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.254201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 269/523] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.259522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.341488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fa56-9beb-4b5b-85e5-f788b4720c5f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.360524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204da13-5476-45f5-ae8a-a6ab27893a47 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.376802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.377454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.377781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.377998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.378773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.379077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.380541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.394320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.394985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.395330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.395643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.396358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.396665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.403177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 255/524] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.403335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.403424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.418314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 270/525] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.418314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.500704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455709-1b16-4e47-841d-eec4f0873b22 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.517023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861842-1d42-47c8-a5cd-1036cbafe79e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.534591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.535235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.535548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.535829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.550377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.551030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.551314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.551626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.552455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.552764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.554190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.559535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 271/526] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.560313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.630065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.632564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.674727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5bacc-3958-4672-b3b1-25ae8e6c6cc5 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.711064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.711871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.712220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.712589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.713504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2cff946b0e734b1ab57587bab203d78d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:28.713884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.715442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.727296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 272/527] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/role_assignments?user.id=2cff946b0e734b1ab57587bab203d78d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:28.728393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.744126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 256/528] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:28.753272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.853933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2a1e-82ed-4b5b-9f65-375457a22ed0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.859372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fad4a-5229-45d2-9a96-14eb686d6c45 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:28.895455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.896708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.896995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.897272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.899125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:28.900228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:28.900506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:28.900779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:28.919454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.920996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.923202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:28.924710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:28.948604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 08:00:28.949882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 273/529] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:28.959895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:28.962361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 257/530] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:28.963241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:28.973212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.066845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111709-bd91-4fb5-847d-090528990615 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.088445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda07b81-abc2-4876-81ee-32a3b5e22e88 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.112777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.113792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.114272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.114757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.115826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:29.116329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.117987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.131507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.131507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.131507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.131507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.131876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:29.131876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.131876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.139591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 258/531] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:29.144523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.150580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 274/532] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 12 08:00:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:29.157156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.287015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729797e6-3707-47db-a342-3a4b45bcc204 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.316120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbacc9f-ad59-4ce2-b4e9-66828e263bb6 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.336802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.337556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.338632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.338632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.366141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.366956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.367243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.367548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.383757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.385279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.403413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:29.412033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.413290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 259/533] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:29.413632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.418618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.515996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 275/534] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:29.524775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.641757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a119-b07a-45a4-9b22-4d4e3e970ae3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.663121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc789d-28cc-4fd8-b15e-0b6ab582d9ab None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.704957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.705772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.706057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.706330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.721039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.721713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.721997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.722280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.723074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:29.723385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.724878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.728511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.729961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.741682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 260/535] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:29.747851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.768156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:29.769701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 276/536] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:29.775101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:29.854501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c7a1-cef8-41df-a1d6-3a5d31b9e5e3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.892499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.893492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.893782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.894188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.895205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=b877e3bebb09444381fdee3fdbe4be24) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:29.895693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.897761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097b47-38e0-4ffd-aac8-7679a37c828a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.906686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 261/537] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/role_assignments?user.id=b877e3bebb09444381fdee3fdbe4be24&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:29.909279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229b750-c927-411d-a520-2c2ffe35b63c None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.909553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229b750-c927-411d-a520-2c2ffe35b63c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.909834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229b750-c927-411d-a520-2c2ffe35b63c None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.915799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 262/538] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:29.918901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.919190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.919489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.941752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:29.942019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b00e56-2968-4c2d-84f7-a32274d7a5e8 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:29.942967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:29.977977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:29.978772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:29.979164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:29.979529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:29.980400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:29.980771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:29.982260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:29.999782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 277/539] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:30.001284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.026386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 263/540] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:30.055525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.123440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6844c-82ac-46c4-bb69-27b1084af733 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.160232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.161031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.161311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.161581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.168586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.170035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:30.185343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:30.191522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 278/541] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:30.191675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6ff3-ddbe-428a-a702-e2367fc1e970 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.196158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.228616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.229556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.229672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.229936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.242313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:30.251023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:30.252592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 264/542] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:30.258311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.302220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cb7d-7977-4a00-90e5-c12e88e8473d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.344772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.346373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.346798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.347210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.348173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:30.348885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.351631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:30.382935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 279/543] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:30.385116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.447795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2437-518a-459b-b350-18faf45e7fec None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.524219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.525324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.525433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.525710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.526466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:30.526843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.528183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:30.542858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 265/544] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:30.544535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb8b9-cf65-4d14-b85f-538e8eefba15 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.548353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.580221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.581277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.581749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.582207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.583233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=0561d7ef7b45441fb6b39aed78cf7921) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:30.583768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.585409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:30.595730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 280/545] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/role_assignments?user.id=0561d7ef7b45441fb6b39aed78cf7921&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:30.726686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f393f-19d0-443c-8d86-383c3483494e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.776726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.777530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.777817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.778090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.797307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.798767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:30.816076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:30.817594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 266/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:30.823634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:30.947030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39426526-e8fb-4a41-857d-626e9b9c3892 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:30.982840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:30.983941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:30.984426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:30.984892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:30.985798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:30.986315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:30.988008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:31.001577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 281/547] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:31.008610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.148006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb400af-a79e-4e20-a01b-7ae68be6f655 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:31.199892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:31.201045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.201521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.201985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.211512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:31.212961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:31.235627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ea0e0107-6815-4221-b8c8-61010f8d511f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:00:31.236768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 267/548] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:31.242459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.341594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0283a-447e-497e-8c61-7819bc6c66cd None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.341943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0283a-447e-497e-8c61-7819bc6c66cd None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.342135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0283a-447e-497e-8c61-7819bc6c66cd None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.343818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 268/549] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:31.348871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.349160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.349463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.374095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:31.375877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:31.454106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad619c-9bba-4097-bb3a-7ef5ec7dc23a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:31.514688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:31.515838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.516120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.516397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.517233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:31.517542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:31.518986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:31.529789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 269/550] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:31.548011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 282/551] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:31.555714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.590286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.676448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01366-1f5d-46c4-92e3-086a174733c9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:31.718807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:31.719465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.719766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.720048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.722804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d57c2-826c-40aa-87be-f3fee59076f2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:31.768076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:31.769146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.769499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.769939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.783236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:31.789000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:31.790591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3468a-dd7a-46dd-9f79-8c3cd3d2c42a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:31.791458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-55ea06d6-b72f-435a-8499-ac6e436e8bbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:31.795554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 283/552] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:31.796940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9287-7521-490f-991a-5d439085f063 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.797228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9287-7521-490f-991a-5d439085f063 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.797747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9287-7521-490f-991a-5d439085f063 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.798868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 284/553] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:31.803630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f9287-7521-490f-991a-5d439085f063 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.902489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 270/554] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:31.903894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.904189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.904467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.921089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:31.922272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:31.930334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f9287-7521-490f-991a-5d439085f063 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:31.973223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:31.973974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:31.974170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:31.975565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:31.975739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:31.976077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:31.977751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:31.994514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 285/556] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:31.995404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:31.995833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 271/556] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:31.996778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.113308 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae3d6-0039-450d-99f4-558d68b74913 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.113606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b33d9-3327-4b59-bff1-a82ad95249fc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.146323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.147119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.147402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.147721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.155028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.156439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.156721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.156995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.159239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.160725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.169306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.171055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.178532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:32.180094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 286/557] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.184439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.192919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:32.199430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 272/558] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.200588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.291862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8fe73-222b-4dd2-883c-032ccbac8f2c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.319550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67df-90c7-4c93-81ae-c65ceb5fd959 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.333635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.334609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.334895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.335555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.349092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:32.356776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.357714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.357987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:32.358406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.358926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.359559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 287/559] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.360106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:32.360407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.360953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.362755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.379715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 273/560] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:32.379715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.503952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26c2d-04b1-4b1e-9cfb-c4c21eaa0525 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.505469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115f3-ec00-4c9d-be99-d2db6ba87adb None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.538209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.539053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.539488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.539743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.540029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.540308 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.540649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.541032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:32.541316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.541423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.542623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:32.542725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.543204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.544798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.554228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 274/561] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:32.555346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.561359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 288/562] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:32.563650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.657063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0ea13-80ba-4500-b628-6e123a57613d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.665554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d68a-c3bb-4b7d-9d51-83b4b13731d9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.695389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.696585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.699583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.699583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.703458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.704328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.704610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.704885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.707748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.709519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.716222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.717677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.725315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:32.727028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 275/563] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.728075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.740715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:32.746219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 289/564] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.747088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.829869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e020-5f67-47f2-b186-c1fe6f6f65a8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.850120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962239-5ecd-4c30-b48f-feed084c65dd None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:32.863684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.864476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.864757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.865035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.871875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.873325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.886469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:32.886701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:32.887185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.887493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.887780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.888652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:32.889061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:32.891052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6614-762d-4838-935a-a34fed93b51a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:32.891611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 276/565] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:32.892892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.906236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 290/566] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:32.907437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c48b9-255e-4213-bdf8-b250e0e34e75 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:32.907703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c48b9-255e-4213-bdf8-b250e0e34e75 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:32.907979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c48b9-255e-4213-bdf8-b250e0e34e75 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:32.909311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 291/567] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:32.912445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c48b9-255e-4213-bdf8-b250e0e34e75 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:32.995298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6597-fe30-4d5b-ad06-f5edd4558eb6 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.013382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c48b9-255e-4213-bdf8-b250e0e34e75 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.029294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.029951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.030230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.031063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.031808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.032110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.033582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.044781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 277/568] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.045878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.054649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.055325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.055647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.055925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.056825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.057352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.058554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c082ee-4ebb-4f10-9bca-d90c4767bb69 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.075182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 292/569] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.076286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.076572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.076848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.092311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:33.094083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:33.139424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092b0a-8f5c-46f9-b29f-e4cb6896f99b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.157041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 293/570] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:33.157905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.171408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.172117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.172399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.172673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.173500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.173812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.175244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ef86-eab2-49b6-a561-775e7277a9c1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.183177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 278/571] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/role_assignments?user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.186028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d419-74da-42f3-82f1-eb8b4af97297 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.186028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d419-74da-42f3-82f1-eb8b4af97297 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.186028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d419-74da-42f3-82f1-eb8b4af97297 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.187367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 279/572] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:33.187848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d419-74da-42f3-82f1-eb8b4af97297 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.279871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb4108-3df8-48da-b020-dd64beb32ab0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.308532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d419-74da-42f3-82f1-eb8b4af97297 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.315732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.316553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.316834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.317107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.325129 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.326615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.341452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 08:00:33.349521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 294/573] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.349521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.353969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.356136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.356546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.357053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.370171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.372537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.394399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-cb8753fd-b23d-49ea-8a4d-9bd2c66d110e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:33.400524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 280/574] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.401675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.401963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.402238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.420365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:33.422101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:33.451596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8fb6-8f11-49d4-886a-61ebc185a14a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.485595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.491647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.491798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 281/575] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:33.491889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.491889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.492043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.511658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:33.519409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:33.520649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 295/576] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.521475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.583595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9834-d7dc-4da3-8e8e-d435b38a594f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.616809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.617470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.617748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.618149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.618828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.619138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.620613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.620859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c2b7-e3f3-4304-8731-e7f4a0a3ec90 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.644891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 282/577] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.644891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.657452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.658653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.659111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.659606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.660804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.661255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.663408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.680555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 296/578] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.681706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.746021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9601-57b9-445e-91b0-85543a959283 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.777247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c1fc-76df-4cbe-9fdc-3c05baf620cc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.778955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.779784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.780065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.780371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.790955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:33.798248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:33.804087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 283/579] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.804087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.814661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.815330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.815647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.815926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.816668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:33.816977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.818333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.826597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 297/580] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:33.828008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.910084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf314f6-76e1-40bf-bd5c-71b944d0cb81 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.925015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cfe20-3446-44e6-97c5-55b47fde423f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:33.942058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.942776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.943056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.943324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.953946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.955390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.958838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:33.959677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:33.960074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:33.960356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:33.968424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:33.969889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:33.974906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:33.976636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 284/581] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.977424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:33.989440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:33.995243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 298/582] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:33.995243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.082127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd138-f888-4996-8e64-731a9f445c46 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.093400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b132b1-f38a-4340-8000-051a431b8507 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.117099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.117767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.118050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.118324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.119062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.119369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.120845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.126014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.126802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.127086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.127367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.134995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 285/583] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:34.136064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.137432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.138877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.156805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:34.158369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 299/584] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:34.159152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.244988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968000e-74c7-4155-971f-d6bb864c1313 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.260378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f13bfe-3bb6-4f77-b2e3-48b01506191b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.283301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.284083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.284372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.284652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.285375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.285696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.287079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.294758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.295694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.296029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.296307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.297097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.297458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.303413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 286/585] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:34.303622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.303731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.311894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 300/586] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:34.313122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.407447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc48ffa-15e0-4a40-888c-c2c00f8cf587 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.421642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23b7cc-e609-4a5a-a314-e632c6aa3551 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.443694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.445241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.445677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.446274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.454532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.455194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.455505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.455788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.456515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.456812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.458207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.458851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.461101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.470212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 301/587] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:34.471004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.483705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:34.485029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 287/588] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:34.489503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.569893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905102f7-9712-4ec6-99be-a40b5e920d58 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.582223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54c86-26c7-4340-9880-55598caba828 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.603662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.604452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.604740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.605015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.611599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.613044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.615073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.615975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.616259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.616535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.626471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:34.632208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 302/589] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:34.632208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.635823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=2c961d005e574c10a93f9a876ac7ce4d, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.637260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.699499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 288/590] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:34 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:34.699499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.755024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ed1a-d0d6-4cc3-9f6a-46ba940ca836 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.793305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.794683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.794996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.795281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.801814 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead4681-c820-4fce-b896-9333ed863208 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.803821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.805538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.822181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 08:00:34.828260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 303/591] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:34.829210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.838907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.839630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.839913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.840183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.840919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.841225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.842612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.855061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 289/592] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:34.855968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:34.946888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb628-5c16-4bd0-8f13-3271ff873480 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.957250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef02a7-7579-42cb-99cc-2110fa70a7b2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:34.990124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.990796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.991081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.991357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.992193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.992514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.994234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:34.994354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:34.995220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:34.995741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:34.996228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:34.997257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:34.997762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:34.999980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.013541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 304/593] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:35.013541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.024633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 290/594] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:35.028019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.133313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82080b9-d92f-434c-9e9b-fc24acd6f39d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.134289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01fcb1-e93b-4fab-bc3c-cb218e2538e9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.178573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.179375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.179691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.179961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.180968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.187254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.187564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.187846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/2cff946b0e734b1ab57587bab203d78d/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.190087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.191602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.204783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=2cff946b0e734b1ab57587bab203d78d, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.206243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.207022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 08:00:35.208438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 305/595] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:35.209195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.291613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 291/596] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:35 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/2cff946b0e734b1ab57587bab203d78d/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:35.294911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.351156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703086e-6622-4dfc-974d-d5e92dac7811 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.437214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febdc02-587b-4448-8419-8786384e291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.438028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febdc02-587b-4448-8419-8786384e291e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.438308 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febdc02-587b-4448-8419-8786384e291e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.438579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febdc02-587b-4448-8419-8786384e291e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.463121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febdc02-587b-4448-8419-8786384e291e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.464762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febdc02-587b-4448-8419-8786384e291e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.497266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1febdc02-587b-4448-8419-8786384e291e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:35.498526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 306/597] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:35.504235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febdc02-587b-4448-8419-8786384e291e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.506392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778faeea-b72f-47e7-9840-547883c8b44a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.543952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.544624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.544908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.545180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.546654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:35.546969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.548449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b787-9a21-46b0-a909-34580a73f936 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.566724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 292/598] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:35.572196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88c9e-18dd-4181-ad3a-d337589a1a09 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.572496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88c9e-18dd-4181-ad3a-d337589a1a09 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.572777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88c9e-18dd-4181-ad3a-d337589a1a09 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.574108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 293/599] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:35.575260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88c9e-18dd-4181-ad3a-d337589a1a09 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.613719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febdc02-587b-4448-8419-8786384e291e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.647795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.648877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.649619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.650097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.651071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:35.651663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.653275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c471b2-d85c-4919-b245-f33876d2321a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.671526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 307/600] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:35.671526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.671526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.671526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.677435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88c9e-18dd-4181-ad3a-d337589a1a09 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.689976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:35.691078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:35.712553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.713338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.713622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.713899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.724315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.725826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.743891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:35.745391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 294/601] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:35.746183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.760626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 308/602] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:35.761469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.857153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06dcb-0935-46be-80ef-bbb59f63e38c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.876913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daefe0-145a-428a-b9ce-0aa23be1549b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:35.891932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.892718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.892996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.893269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.900463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.901922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.912062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:35.912775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:35.913059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:35.913434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:35.914159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:35.914463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:35.915898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:35.916705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:35.917928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 295/603] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:35.918718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:35.928942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 309/604] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:35.934214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.022096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bd361-e14c-439d-83fa-851738319f38 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.036127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e23f0-ae04-42f3-8665-0c931e13468f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.056704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.057495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.057774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.058043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.068097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:36.070814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.071552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.071843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.072121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.072905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:36.073216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.074642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.075075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:36.076579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 296/605] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:36.078163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.088247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 310/606] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:36.089092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.181075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0113475-2fed-42b9-b6cd-46456b690b0f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.199870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5b66-c709-40e5-83bc-77160b83963b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.217561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.218395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.218825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.218939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.225676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.227106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.236439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.237298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.237725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.238167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.239051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:36.239534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.240631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:36.241250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.246451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 297/607] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:36.246451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.257497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 311/608] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:36.258531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.357930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab52ed-65fe-451a-b2d2-19a500aaba66 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.389163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8666-deca-4f3b-bab1-8222d5755d0d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.403650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.405896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.406165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.406507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/b877e3bebb09444381fdee3fdbe4be24/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.426905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.428406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.428850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.429280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.429617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=b877e3bebb09444381fdee3fdbe4be24, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.430466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:36.430929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.431115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.432852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.448560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 312/609] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:36.451945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.535422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 298/610] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:36 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/b877e3bebb09444381fdee3fdbe4be24/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:36.544673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.592392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f27e08-24d4-4fdd-804e-751c32022dca None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.670989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.673863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.674364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.676053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.696470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.698496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.733379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:36.735445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 313/611] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:36.740750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:36.760613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e1e8-cd59-42fa-b790-68543565b723 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.807266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.808551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.808837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.809110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/0561d7ef7b45441fb6b39aed78cf7921/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.827940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=0561d7ef7b45441fb6b39aed78cf7921, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.829857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.864149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aa0ce-1bff-426b-912b-d397ec398cb8 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:36.895001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 299/612] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:36 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/0561d7ef7b45441fb6b39aed78cf7921/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:36.902075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:36.902765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:36.903140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:36.903419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:36.904329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:36.904848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:36.906357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:36.919431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 314/613] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:36.925291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.063457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21832-c66f-4149-89e8-eab1a30db34b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.109543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.110348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.110627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.110898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.118259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.119733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.135304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8db5fcf1-38fd-437e-a1fe-6fdb78f0ea22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:00:37.136515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 300/614] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:37.142803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.204413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236e1-f1ee-41b4-9477-56fe3ba68d33 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.204702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236e1-f1ee-41b4-9477-56fe3ba68d33 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.204967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236e1-f1ee-41b4-9477-56fe3ba68d33 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.206346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 301/615] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:37.211570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.211869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.212153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.232464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:37.234455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:37.272633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c431-fe74-4bec-9dec-a73c08cf6678 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.312869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 302/616] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:37.343703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.350206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.350900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.351183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.351460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.352323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:37.352630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.354169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.373452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 315/617] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:37.379836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.458360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad259e-b3a5-4458-9bfe-b88bb4d95740 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.496884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.497896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.498186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.498465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.512829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:37.522115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:37.527854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 303/618] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:37.531056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.591103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1930138-1f5b-445e-bdbe-46a7d818a809 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.639570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e081-3716-4ca9-936e-906d04d3d473 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.673971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.674977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.675191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.675585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.676138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.676773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.677059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.677340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.678087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:37.678395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.679807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.689723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 304/619] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:37.694973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.698785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.700477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.727151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:37.736746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 316/620] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:37.742127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.802471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfdd81-f70d-439b-a43a-5f86b0c70c0d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.848406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.850440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.850734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.851012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.870614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.872200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.892955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:37.894677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 305/621] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:37.900640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:37.932545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352bf6-35fb-4508-adcb-22a43c78adba None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:37.967344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:37.968097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.968386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.968667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.969396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:37.969707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:37.971160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c9f9-8cbf-4e13-9fa1-4f86e4dac633 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:37.982825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 317/622] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:37.984717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d6-9a3c-477f-b82b-1b37fc7e5c80 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:37.985011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d6-9a3c-477f-b82b-1b37fc7e5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:37.985290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d6-9a3c-477f-b82b-1b37fc7e5c80 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:37.991274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 318/623] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:37.992789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b2d6-9a3c-477f-b82b-1b37fc7e5c80 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.031409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f505b-eac6-41d2-9463-582abbd1e034 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.074792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.076043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.076564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.077427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.078693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:38.079368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.081300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f465c-c6ac-4af6-bb7e-30a07d132399 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.095567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b2d6-9a3c-477f-b82b-1b37fc7e5c80 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.097068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 306/624] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:38.098820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.099326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.099832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.118071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:38.119265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:38.144411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.146068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.146807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.147297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.156741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.158482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.185044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:38.191038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 319/625] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:38.191038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.196930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 307/626] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:38.202908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.313597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37af72-42eb-421a-9f72-d51ec1d77c08 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.323033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4e97-9ebf-4308-8c4b-26fc98148ee6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.361331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.362145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.362435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.362723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.369998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.371596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.375021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.375021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.375021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.375350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.375611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:38.376474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.379111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.387363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:38.393490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 320/627] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:38.394598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.402723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 308/628] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:38.402723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.519250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0ad0-bc93-4f7c-a979-e7e88d554816 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.522542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5bca2-a133-41e2-b576-7c310ff7f51f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.557007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.558034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.558505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.559010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.559393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.560279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.560391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:38.560680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.561020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.561237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.563661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.574347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:38.582158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 309/629] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:38.583202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:38.583372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.584782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 321/630] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:38.587776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.681891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344e0e-ea5b-49dc-983c-36cce65cceeb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.714124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3940b4-cbc9-4838-9d6d-952a0145711c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:38.722571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.723789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.724269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.724748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/a35f5b8f9e834adb8d67eb2b6fb4ec62/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.744190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=a35f5b8f9e834adb8d67eb2b6fb4ec62, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.746857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:38.764356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:38.765068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:38.765353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:38.765674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:38.809647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 310/631] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:38 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/a35f5b8f9e834adb8d67eb2b6fb4ec62/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:38.809647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:38.896007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:38.897506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.014358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d6f97-a256-4d3d-a21f-ff684690d97d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.071032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 322/632] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 08:00:39.073379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.074078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.074354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.074625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.079410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:39.079410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.079410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.080437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.087207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 311/633] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:39.093764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.202678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bfb0-2546-404b-8c78-88900fc969b7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.240896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.241702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.242045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.242326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.253699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.255157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.274568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:39.276279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 323/634] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:39.284444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.309970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb476e09-2553-4b61-929f-1b8244f3f15e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.351213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.352049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.352338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.352615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.364137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.366606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.385594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1a95f528-3854-468e-8ac7-42ec34afcb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:39.387147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 312/635] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:39.388761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2775cb-5275-428a-8651-6c9254f30635 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.389256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2775cb-5275-428a-8651-6c9254f30635 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.389817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2775cb-5275-428a-8651-6c9254f30635 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.398191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 313/636] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:39.400048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2775cb-5275-428a-8651-6c9254f30635 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.416626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc659-c3bd-4710-a585-d6a3a28e3628 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.459340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.460260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.460546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.460817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.461538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:39.461905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.463271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb0ef-5ef9-4e70-acab-cfb6ddd65f45 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.484105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 324/637] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:39.486035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95b47-84ba-420b-a164-c5c05d3e9866 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.486327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95b47-84ba-420b-a164-c5c05d3e9866 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.486761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95b47-84ba-420b-a164-c5c05d3e9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.505664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-3fe95b47-84ba-420b-a164-c5c05d3e9866 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:39.506870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3fe95b47-84ba-420b-a164-c5c05d3e9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:39.526346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2775cb-5275-428a-8651-6c9254f30635 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.566375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.567508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.567823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.568101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.569122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:39.569432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.571266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.584341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 314/638] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:39.585110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.592085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 325/639] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:39.594441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2b0e-4685-46ee-87fc-3a843338d644 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.594927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2b0e-4685-46ee-87fc-3a843338d644 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.595397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2b0e-4685-46ee-87fc-3a843338d644 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.597171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 326/640] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:39.598086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb2b0e-4685-46ee-87fc-3a843338d644 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.697893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c839-06b7-4fbf-b7db-0b532411da05 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.703166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb2b0e-4685-46ee-87fc-3a843338d644 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.731184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.731928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.732209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.732547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.740090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.740948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.741529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.741742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.742021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.742294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.749943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:39.751354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:39.756263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-6d692ed5-3271-4fa2-8716-fbd2790fd419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:39.762043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 315/641] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:39.762043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.762043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.762043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.770498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 08:00:39.772017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 327/642] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:39.772800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.780957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:39.782151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:39.863517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 316/643] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:39.863517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.888839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae64c3-8271-4709-9ea3-d7fc421f6964 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:39.925098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:39.925896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:39.926185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:39.926463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:39.937023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:39.944111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:39.945469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 328/644] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:39.946157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:39.966514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce37c-0894-4cfb-927f-821349d0179d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.004712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.005306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.005589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.005872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.006677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.006989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.008514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.020894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 317/645] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:40.021831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.051842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e58a-a4b0-4410-927a-07ff465ebc9b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.084337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.085106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.085399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.085846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.087313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.087749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.090196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.109272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 329/646] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:40.110441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.128945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d16fd-9258-4125-ad4f-83daeee99643 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.163572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.164737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.165212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.165674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.181064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:40.189683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:40.191063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 318/647] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:40.191723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.213552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feb07d-bf60-461d-9ada-414599204ec4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.246869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.247573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.247858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.248134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.249452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.249760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.251117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.258684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 330/648] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:40.259409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.296366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235049f-4390-47f5-a365-863c76f1a1c8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.328422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.329071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.329356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.329639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.330615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.330928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.332384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.347506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 319/649] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:40.347506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.379227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1611b-d09d-41ed-a69f-a3048390861a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.427457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.428241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.428527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.428801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.455221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d168dc-9711-4a71-ad5c-967e54402f66 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.493174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.493610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.494176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.494650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.495892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.496255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.497711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.511413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:40.512345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.521792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.524059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.636009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abedd0-5c69-4675-8f3d-210286f3e6dc None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.644123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 331/651] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:40.645706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.685511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.687271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.687588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.687866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.703117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.705065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.726450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:40.728655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 321/652] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:40.732026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.754737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37e60-5f71-4af7-9b60-dc8090dbf397 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.798984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.800013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.800301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.800581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.813961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.816134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.832422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9d8c-8485-4454-bb8f-6d5c377fb64b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.838396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:40.843566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 332/653] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:40.844438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.869382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.870183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.870510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.870787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.882212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.883738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:40.901236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:40.902719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 322/654] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:40.903517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:40.951400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f360-9189-423f-8110-cf37fdf5df78 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:40.988353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:40.989019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:40.989304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:40.989581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:40.990301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:40.990611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:40.992012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.006252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216bc-d2ec-469b-ab8e-a60e65bceb41 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.008959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 333/655] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.009840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.039773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.040429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.040712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.040987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.041764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:41.042071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.043486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.056667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 323/656] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.057426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.113329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887691a7-7f62-4f6d-a6cb-f0113e00c2a9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.152667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.153650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.154075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.154468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.155251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:41.155739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.157710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.159208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072c1-4ccc-4724-ba33-707b05511918 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.173032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 334/657] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.174275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.214541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.215549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.215840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.216114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.224757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.226899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.245791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 08:00:41.247602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 324/658] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:41.248454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.296749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87490-f2dc-484e-8faf-05cd24321c65 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.331669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.332885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.333370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.333861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.341728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.344069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.359427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 08:00:41.361119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 335/659] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:41.362022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.363340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508593c0-fb31-42f8-ab66-f5fc194468d8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.397890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.403700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.403700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.403700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.406568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.408056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.423611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-f9784492-9953-41c4-a604-4af4568c9faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:41.425071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 325/660] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:41.427091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60463-3399-4d0e-800e-51b8b15b360f None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.427580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60463-3399-4d0e-800e-51b8b15b360f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.427863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60463-3399-4d0e-800e-51b8b15b360f None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.429289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 326/661] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:41.429838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e60463-3399-4d0e-800e-51b8b15b360f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.482078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc900e-2573-48cf-bc12-703a0c0b3803 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.515988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.516655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.516931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.517209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.518036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:41.518347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.519774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.534204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e60463-3399-4d0e-800e-51b8b15b360f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.536813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 336/662] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.542209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.567960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.568908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.569363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.569639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.570466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:41.570778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.572236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d734-9e2b-4383-b654-21aa814b3898 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.589446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 327/663] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.590694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.590979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.591249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.608979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:41.610158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:41.653766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804416-369f-4e63-8dc2-54788f5e3c96 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.676222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 328/664] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:41.677590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.701473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.702725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.703007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.703279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.704095 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:41.704403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.705890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.719009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 337/665] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:41.720417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:41.785971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7a3c-57b2-478c-83b8-9aac91172f5d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.824305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.824968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.825254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.825533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.827589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21901f-a6d0-4cbe-adb4-0fd8cf59cae4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:41.866164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:41.867366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:41.868102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:41.868550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:41.891263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.892775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.938638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:41.940125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:41.986851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 329/666] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:41.987974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.036314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 338/667] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:42.037467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.089370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e9dc2-e6ec-4fc1-916f-5448799002bd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.130406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.131183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.131463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.131789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.134055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9f5d-4acc-4ed5-9789-568bfd50176f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.142879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:42.150339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:42.156289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 330/668] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.156289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.167701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.168361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.168642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.168923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.169760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2cff946b0e734b1ab57587bab203d78d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:42.170074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.171587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.178703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 339/669] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/role_assignments?user.id=2cff946b0e734b1ab57587bab203d78d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:42.178703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.275554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2473eb-571a-47f3-b926-6d0be5cb5179 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.286170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa9257-577f-4109-8c33-bd20c0aa8aa9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.312921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.314236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.314767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.315245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.322173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.322998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.323279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.323588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.330464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.332331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.336010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.345650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.352504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:42.358478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:42.359146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 331/670] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.360302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.362674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 340/671] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.364627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.489892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a434f4-b012-449e-a8d5-34206a4f4da5 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.496094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d713-6c03-428d-be0b-d7e90b21e1c3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.529485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.530760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.531045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.531321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.532063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:42.532371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.533732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.538282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.538956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.539237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.539531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.540280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:42.540586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.541938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.550904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 332/672] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:42.551870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.552109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 341/673] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:42.560444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.650490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83028-2447-4c95-8152-114993a94e34 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.659836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31608-3fa8-4079-b558-4d24a3738baa None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.684696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.685370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.685640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.685918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.687209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:42.687575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.688907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.697337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.698411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.698891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.699356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.706475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.706736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 333/674] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:42.707605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.708733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.722244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:42.724139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 342/675] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.725142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.806495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc6f08-ee88-4b80-b89a-67da44822dac None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.826206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3ec08-acbf-4514-b801-705ef8066576 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.841429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.842221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.843062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.843339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.853235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.854698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.861209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:42.862109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.862399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.862679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.869029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:42.870448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:42.871034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:42.877056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 334/676] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.877056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.888582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-a1399062-37c6-4991-8103-27b5e126cc19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:42.890503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 343/677] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:42.891576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88065-d1c5-4818-8c7a-4e4a6694f3be None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:42.891863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88065-d1c5-4818-8c7a-4e4a6694f3be None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:42.892142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88065-d1c5-4818-8c7a-4e4a6694f3be None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:42.893526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 344/678] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:42.894093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b88065-d1c5-4818-8c7a-4e4a6694f3be None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:42.977293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb921-33f1-4515-abe9-7fe3669bd469 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:42.999873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b88065-d1c5-4818-8c7a-4e4a6694f3be None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.012513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.013173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.013452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.013722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.014557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.014866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.016362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.033254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 335/679] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.033254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.038544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.039212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.039512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.039793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.040510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.040815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.042176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392b88-0241-4911-b77d-f5444ce8c373 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.058886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 345/680] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.058886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.058886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.058886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.072822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:43.073997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:43.140083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204061c3-8cb4-421b-bfa6-5fd032af7a30 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.141376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 346/681] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:43.142325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.192050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.192732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.193118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.193296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.194099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.194396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.195852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.212447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 336/682] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.212447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.250502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749d10-e5b7-4f2d-a7d0-0861b2cce1b4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.283503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.284165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.284446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.284842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.285668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=b877e3bebb09444381fdee3fdbe4be24) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.286163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.287391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.303863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 347/683] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/role_assignments?user.id=b877e3bebb09444381fdee3fdbe4be24&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.303863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.315445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b8d5-fc27-4a68-a894-a34a15f257da None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.360933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.362097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.362389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.362667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.375144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.376972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.396583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:00:43.406235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 337/684] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:43.406235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.444478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f951ff-34c4-4f2a-98de-c4e61a29a989 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.491616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.492479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.492705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.492986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.506985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:43.513906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:43.516178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 348/685] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:43.516810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.531145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747db08-97c6-40b6-84a8-b2ee3bb0e9fd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.569869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.570503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.570792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.571069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.571994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=0561d7ef7b45441fb6b39aed78cf7921) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.572296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.573778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.583611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 338/686] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/role_assignments?user.id=0561d7ef7b45441fb6b39aed78cf7921&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.583611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.662817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c0052-2595-4326-b905-72ee4ffef7e1 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.718973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.719730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.720013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.720285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.721186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.721496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.722944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.746126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 349/687] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.747579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.795598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978666a-f145-443e-a461-36508e4b87eb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.853672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.854274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.854995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.855280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.856340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:43.856652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.858560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.868978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133115f-6266-4dfb-bb9c-6cfcf361ab4c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:43.876416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 339/688] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:43.877964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:43.912520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:43.913169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:43.913450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:43.913723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:43.991103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:43.992707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:43.998323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395923be-fd4e-4d19-adbb-f8d2d9fe9175 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.046881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.047754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.048082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.048358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.069739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.071209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.106182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:44.106182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 340/689] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:44.112204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.145141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 350/690] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:44.150824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.259275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4eb02-0358-459f-8a80-2ccfb711504e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.298943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.299781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.301087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.301371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.324014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.325457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.348640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:44.350713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 351/691] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:44.356295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.358052 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05e764-7b82-4a89-bee3-1415ff5c95cf None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.437476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.438978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.439729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.440431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.441430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:44.441897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.443465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.473256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 341/692] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:44.475144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090d03-72bf-4cd8-ad8e-c47dcbf07ccc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.478104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.513392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.514933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.515444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.515995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.516943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:44.517491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.519070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.534535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 352/693] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:44.539360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.667674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66581e9-153f-465f-b754-4457c03ecb70 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.723372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ea78e-153c-415f-ad38-1889b0e0d7f4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.737258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.738433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.738918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.739393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.751295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.753856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.775330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:44.784717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 342/694] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:44.786856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.787935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.788440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.788922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.790696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.800737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.805116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.822908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-db5fccec-db30-4e64-a4df-175ff897064e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:44.824559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 353/695] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:44.826056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c23cc-dbd0-436d-88a1-8f675821f782 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.826258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c23cc-dbd0-436d-88a1-8f675821f782 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.826527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c23cc-dbd0-436d-88a1-8f675821f782 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.828759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 354/696] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:44.833848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.836142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.836142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.857488 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:44.858995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:44.902427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38ccb-f149-4ea3-b635-69ec35d98ad2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:44.939431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:44.940110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:44.940394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:44.940679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:44.941530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:44.947557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:44.947557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:44.948065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 355/697] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:44.949109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:44.968358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 343/698] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:44.969984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.064934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e06715-faf5-4f9a-88fb-bb03ff4346a2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.097776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c423-ed9a-4ed2-bdf6-5b4523a13a21 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.099352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.100245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.100695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.101135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.102076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:45.102552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.104197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.119724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 356/699] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:45.120802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.135394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.136356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.136644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.136921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.219996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.221640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.228347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def7d36-e18e-4323-a735-c195ddb71630 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.260791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.261851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.262320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.262778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.273828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.275849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.293121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:45.299792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 357/700] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:45.300814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.339033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 344/701] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 08:00:45.340192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.407352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f10fad-6424-4ba1-aa13-26e68900405e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.441189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.442187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.442711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.443152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.444206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:45.444688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.446355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.459644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 358/702] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/role_assignments?user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:45.460879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.463192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b7bb9-351d-48d2-986f-de59b3448f96 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.504161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.504762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.505047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.505322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.509092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:45.509092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.509092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.523367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 345/703] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:45.529580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.630194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e52bb-acfd-4a69-b82b-004819a54ae4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.666908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.668070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.668525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.668985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.680160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.681910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.688819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bfaa-9b46-4f25-8c49-8ccc8883d0d5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.708372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:45.710189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 359/704] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:45.725552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:45.729860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.730553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.730838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.731113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.731860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.733370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.825343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 346/705] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:00:45 2022] POST /identity/v3/users => generated 254 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:00:45.852671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a23ef-fa62-4061-b1a1-aaa163dafe08 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:45.896158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:45.897138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:45.897590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:45.898054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:45.898961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:45.899728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:45.901465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc4b2-5d3e-444a-9a08-02848f257827 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:45.917704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 360/706] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:45.923714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.006146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330de1-b832-4b97-93c9-6d9800f3a63f None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.006746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330de1-b832-4b97-93c9-6d9800f3a63f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.007271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330de1-b832-4b97-93c9-6d9800f3a63f None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.009776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 361/707] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:46.016129 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.016762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.017228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.036245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:46.037486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:46.038806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f6a27-0f82-42b6-8586-7f9571c885c2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.079745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.080510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.080790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.081124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.088211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.089672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.103711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:46.105222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 347/708] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:46.111443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.125175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 362/709] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:46.156203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.236243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc5c5-c1d7-41c8-9966-b0fbe191c4c9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.273452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.274118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.274661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.274931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.275760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.276069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.277518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bce70-0c08-4f9a-bf2f-a3b245c11e0b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.290903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 348/710] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:46.292580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633453-33fb-490b-82bb-840d368b0bdf None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.292871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633453-33fb-490b-82bb-840d368b0bdf None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.293137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633453-33fb-490b-82bb-840d368b0bdf None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.293871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a34a0d-609b-40ab-bf43-65f143ea2e4e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.294504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 349/711] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:46.296965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633453-33fb-490b-82bb-840d368b0bdf None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.336486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.337736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.338217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.338698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.339537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.341082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.354785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-543cea21-c248-4322-a155-0a1319f5d974 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 08:00:46.356368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 363/712] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:46.357570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.358399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.358682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.379695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:46.380928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:46.425899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633453-33fb-490b-82bb-840d368b0bdf None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.452856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 364/713] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:46.454490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.479199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.479890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.480219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.480496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.481327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.481687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.483834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.489835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 350/714] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:46.490773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.570992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7926-8034-42ce-bb8b-8f1a3f039b2a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.596847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90275533-13dd-436e-ad77-b80dd22fea67 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.606133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.606823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.607102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.607373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.608166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.608469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.609887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.614799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 365/715] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:46.620379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.632921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.633788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.634068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.634343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.635003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.636459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.650817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 08:00:46.652417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 351/716] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:46.660297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.727634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec19844-7284-4e1d-9aed-e1776cfb8614 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.762648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.763315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.763619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.763887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.764837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cdbc-0409-4afa-8e1f-5ce43640cdb8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.765148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.765451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.766800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.772811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 366/717] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:46.802750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.803543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.803837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.804116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.804957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] RBAC: Adding query filter params (name=network) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.805270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.806852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a52399-c4e9-415c-8e96-916e0c5e2a48 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.813021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 352/718] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:46.818184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:46.939511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f4b4-1e1b-4354-806f-f154a44b012f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:46.984305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:46.985001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:46.985279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:46.985554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:46.986278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] RBAC: Adding query filter params (type=network) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:46.986588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:46.988033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c114e-819d-4930-8885-755ffabd159a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:46.993651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 367/719] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:48.713578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d4e5-783b-4ad1-96cd-f2bc0d01dba9 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:48.714286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d4e5-783b-4ad1-96cd-f2bc0d01dba9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:48.714286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d4e5-783b-4ad1-96cd-f2bc0d01dba9 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:48.715738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 353/720] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:48.721332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02ba1-db8a-4bc3-8838-56717c26618c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:48.721853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02ba1-db8a-4bc3-8838-56717c26618c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:48.722027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02ba1-db8a-4bc3-8838-56717c26618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:48.744505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4db02ba1-db8a-4bc3-8838-56717c26618c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:48.745721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4db02ba1-db8a-4bc3-8838-56717c26618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:48.830087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 368/721] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:48.866016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d4e5-783b-4ad1-96cd-f2bc0d01dba9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:48.901573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fa63d-8eff-4662-b45d-8e474c694d77 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:48.901880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fa63d-8eff-4662-b45d-8e474c694d77 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:48.902142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fa63d-8eff-4662-b45d-8e474c694d77 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:48.903808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 369/722] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:48.908936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:48.909223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:48.909505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:48.944476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:48.945664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:49.039688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d4e5-783b-4ad1-96cd-f2bc0d01dba9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.076287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 370/723] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 08:00:49.089308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.090400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.090949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.091412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.102670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:49.109278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.122245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:49.126292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 354/724] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:49.132289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.267372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012b928-780f-4161-9d93-225aecb2d863 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.312856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.313788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.314296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.314830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.325534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:49.333026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:49.334806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 371/725] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:49.340752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.361445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa550e-f2c3-4769-b9a5-1d9c65e0bde8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.426992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.427573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.427857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.428131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.428927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:49.429173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:49.430530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:49.439974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 355/726] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:49.445625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.448198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcde90-7411-4843-ad8c-55344c992aa9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.483657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.484720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.485203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.485686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.486621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:49.487125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:49.488806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94052e62-b774-4dcd-be78-9b3515d7f87a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:49.498263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 372/727] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:49.500625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50872e28-60db-4337-b605-092c88f1763e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.501119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50872e28-60db-4337-b605-092c88f1763e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.501646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50872e28-60db-4337-b605-092c88f1763e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.503352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 373/728] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:49.504922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50872e28-60db-4337-b605-092c88f1763e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.629012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf61d-93b6-4d9c-a0fe-4b7f9365bb6e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.667911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.669590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.670990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.671498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.686785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:49.688560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:49.708194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-02427689-5109-47ed-aba1-f6b46f835bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:49.714489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 356/729] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:49.716420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.716885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.717864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.732157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50872e28-60db-4337-b605-092c88f1763e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.741741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:49.743175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:49.782146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.782948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.783234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.783528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.794155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:49.796334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:49.813662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-fdcc5d82-c5dd-41c9-b21a-e685fecb9842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 374/730] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f19a-cb1c-48a3-8bb0-46dd4bf99fb2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f19a-cb1c-48a3-8bb0-46dd4bf99fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f19a-cb1c-48a3-8bb0-46dd4bf99fb2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 375/731] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:49.819366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f19a-cb1c-48a3-8bb0-46dd4bf99fb2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.830265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 357/732] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:49.831915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:49.936410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f19a-cb1c-48a3-8bb0-46dd4bf99fb2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.959286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e664-9c98-4f8c-b6d6-a9d043f1a53d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:49.975170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:49.976097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.976378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.976649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:49.977362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:49.977665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:49.979018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc727d-55f9-43bd-85da-a0dad67af0aa None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:49.992319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 376/733] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:49.992319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:49.992319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:49.992319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.005681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.006346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.006625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.006903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.007744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:50.008051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.009441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.010834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:50.012038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:50.025345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 358/734] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:50.025345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.082123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 377/735] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:50.082953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.119544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c067-0379-4397-bbd3-821b367bccd1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.151137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.151956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.152239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.152512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.162071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:50.168983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:50.175211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 359/736] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:50.175211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.188019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61132a4-3b24-4a00-a1ed-a6b9c1efae0d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.220255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.221041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.221325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.221598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.228297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.229723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.243497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c2e42da0-b643-4900-aa05-78ed4026138f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:00:50.244655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 378/737] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:50.245834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4a7b3-3589-48e6-90d0-a9b8f0fb2f88 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.246121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4a7b3-3589-48e6-90d0-a9b8f0fb2f88 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.246391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4a7b3-3589-48e6-90d0-a9b8f0fb2f88 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.247802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 379/738] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:50.248995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4a7b3-3589-48e6-90d0-a9b8f0fb2f88 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.271636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f813-a453-40b3-8ade-8c5d2d2b018d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.303595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.304391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.304674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.304943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.312853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.314296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.327690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:00:50.328834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 360/739] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:50.329587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.343903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4a7b3-3589-48e6-90d0-a9b8f0fb2f88 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.375679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.376332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.376612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.376881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.377583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.378930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff70e2-993b-4e53-988b-f75f1272bc21 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.423084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee0c6-8eef-46e7-b2ad-8d18f8931305 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.453932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.454527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.454811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.455092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.455858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:50.456166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.457519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.465157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 361/740] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:50.465937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.470820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 380/741] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:00:50 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:50.472296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.475883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.475883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.490464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:50.491720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:50.583855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 381/742] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:50.583855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.584148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2caa2-caab-45f1-aae5-7e67fe524c35 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.615203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.615922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.616207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.616480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.617328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:50.617636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.619113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.637451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 362/743] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:50.638326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.685388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1bb4-7812-430c-a13a-f9c87c9cd5b4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.720616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.721238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.721523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.721798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.722636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:50.722995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.724484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.740803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25916561-2a08-4efd-8f04-6f9a27d47fd6 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.741436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 382/744] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:50.742249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.779034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.780454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.780740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.781018 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.791581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.793034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.809847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:50.815506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 363/745] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:50.815506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:50.838180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d61e4-dd54-4483-80c9-e51327b4f9bd None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.871974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.872638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.872922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.873219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.873940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:50.875351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:50.909273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a2a3-fc5a-48a0-80e2-a091bb4b2162 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:50.941044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:50.941688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:50.941974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:50.942246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:50.950097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 383/746] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:00:50 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:50.951080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.015254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.016847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.103020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4ab2-3f6a-4cbd-98a4-b216e58d324c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.126994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 364/747] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:51.128173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.143023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.143829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.144183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.144528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.234444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.236850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.241250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f72a1-e51c-4d49-b596-ab263ccd17ce None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.276264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.277233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.277688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.278140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.279047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:51.279654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.281245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.293335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 365/748] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:51.294486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.337751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 384/749] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:00:51.338608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.397753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e100-5a6f-44de-be6b-695bd14217de None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.431626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.432427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.432714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.432986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.437557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408540d-974a-46b2-8b6b-4c0dd79e56b6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.444129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.445576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.463611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:51.466229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 366/750] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:51.467796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.471634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.472433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.472711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.472985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.480308 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.481737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.496224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:51.497771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 385/751] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:51.499121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.567641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f37a6-7e05-4420-90ad-0c078c01420b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.597360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef93e1-4ec6-4cf2-a470-3d3ebe27045a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.601384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.602188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.602471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.602750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.613961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.615432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.631757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.632439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.632725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.632904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:51.633004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.633796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:51.634103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.634486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 367/752] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:51.635315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.635593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.649951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 386/753] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:51.650937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.744385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63b03-2c3a-41ba-9d8b-aa12d70aaabd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.753401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4535-f8a1-439b-9b3e-96cdf162662c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.778170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.778844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.779125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.779431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.780350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:51.780661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.782095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.787531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.788193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.788473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.788791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.789514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:51.789870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.791280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.800388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 368/754] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:51.801235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.804436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 387/755] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:51.812466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.900022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c24f0-019d-4c2d-8a59-dec6a792cf22 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.912639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb5b0-65a0-45a6-8bd4-c6ae892736a4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:51.937599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.938403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.938689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.938967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.946012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.946638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:51.947439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.947644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:51.947811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:51.948008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:51.955320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:51.956781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:51.961315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:51.962825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 369/756] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:51.963636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:51.976273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:51.982252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 388/757] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:51.983666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.063014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8255c8-88df-4da6-a5f5-612c60c6698d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.081645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978ec8-ecb1-4a90-9961-b0642f1823b9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.096219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.097024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.097307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.097584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.108874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.110334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.121506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.122218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.122511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.122916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.123816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.124126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.125547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.127277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:52.128804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 370/758] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:52.129591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.147551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 389/759] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.148487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.237259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060fc26-4cf7-4bc5-b3f7-53603318e034 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.255798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d1e0-2b4f-4475-a7f0-7f894b5d2347 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.270695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.271354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.271669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.271946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.272731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.273040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.274737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.289587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.290259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.290540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.290815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.291579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.291759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 371/760] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.291922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.292598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.293518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.307001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 390/761] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.307879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.398679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c4000-a9e3-4898-9f23-0529105b2a0d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.406854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7a4b4-4eea-4713-9071-a844224a2c44 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.433110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.433768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.434050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.434355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.435200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.435522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.437528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.441976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.442634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.442917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.443193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.444055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=dc77bc705e44486fa93db5f88ccaa7b4) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.444367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.445932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.451574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 372/762] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/role_assignments?user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.452511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 391/763] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/role_assignments?user.id=dc77bc705e44486fa93db5f88ccaa7b4&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.452682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.567267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51958b6-a8fc-4c93-b013-12b6b7b751ad None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.611215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.612067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.612349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.612625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.621786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.623836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.643087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:52.649034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 373/764] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:52.655782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.811888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9802-ff95-4891-b0d7-045da1971156 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:52.849890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:52.850559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.850841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.851116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.851932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:52.852242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:52.853664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18b47-a653-41a7-bb02-07433dc615fc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:52.870367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 392/765] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:52.871779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:52.957142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5eeef-b3ab-4afb-bf1d-9497687baecf None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.957464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5eeef-b3ab-4afb-bf1d-9497687baecf None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.957700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5eeef-b3ab-4afb-bf1d-9497687baecf None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.959291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 393/766] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:52.964426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:52.964708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:52.964983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:52.973545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eeeb2-1347-4e53-9342-5fcb8ff51299 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.004475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:53.005676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:53.008202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.009100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.009382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.009651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.011639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=2c961d005e574c10a93f9a876ac7ce4d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.013066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.080774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 394/767] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:53.104241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.111875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 374/768] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:52 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:53.249549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78a18-0726-4e4d-9558-cabc26266773 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.302685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.303944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.304431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.304928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.305803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.307415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.323502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 08:00:53.325402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 395/769] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:53.331930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.462300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd218-6669-48ff-8df7-a03162d88d90 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.499998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.500674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.500960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.501238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.501952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:53.502263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.503666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3e23-0b39-4069-94a6-c908b9f2ce60 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.508779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 375/770] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:53.513931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.619214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebb972-31ea-4b4b-a9a3-3d1bbcf47076 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.619860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebb972-31ea-4b4b-a9a3-3d1bbcf47076 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.620368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebb972-31ea-4b4b-a9a3-3d1bbcf47076 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.622546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 376/771] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:53.627800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.628472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.629066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.647703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:53.650035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:53.663251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c95e3-7f53-40e5-900a-b468343d39a6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.697678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.698703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.699188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.699694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.701094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:53.702138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.704438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.711587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 396/772] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:53.720415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.730680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 377/773] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:53.806018 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.847526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a439e-733d-4be4-95f9-42aeb0adf38f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.877507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] RBAC: Adding query filter params (interface=public, service_id=77bb292a9bc348f4a4d1b1ec2aaa0a3a, region_id=RegionOne) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.883503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.889510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 397/774] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/endpoints?service_id=77bb292a9bc348f4a4d1b1ec2aaa0a3a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:53.896399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:53.942937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d85f54-28f5-41d7-9913-3c21ad7e93d0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:53.979746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:53.980989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:53.981544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:53.982020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] PATH_INFO: `/v3/services/network` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:53.982907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:53.985473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:53.997651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 08:00:53.999509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 378/775] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:54.004869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:54.112802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7b5-695e-4817-b5bb-7ed3d502d3a7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:54.179548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:54.180616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:54.181127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:54.181606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:54.182496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:54.184279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:54.186989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049eb4-0c3c-464f-b8f9-8a9058fe9a3f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:54.198613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 398/776] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:00:53 2022] GET /identity/v3/services => generated 772 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:54.257868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:54.258564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:54.258846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:54.259122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:54.259887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] RBAC: Adding query filter params (name=network) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:54.260194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:54.261626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:54.272305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 379/777] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:54.278277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:54.426953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27f01-6c94-4739-9405-f8ce437dd74c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:54.463620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:54.464627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:54.465111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:54.465660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:54.466560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:54.467214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:54.468816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:54.475361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 399/778] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:54.483521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:54.597335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87fb12-9a61-40cc-aed0-754d83624266 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:54.643709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:54.644384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:54.644666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:54.644940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:54.645746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] RBAC: Adding query filter params (interface=public, service_id=45583fd23b6c40b18175164914e5040e, region_id=RegionOne) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:54.646064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:54.647448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d9972-7705-44e3-a1f3-22d416d1be95 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:54.659101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 380/779] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:00:54 2022] GET /identity/v3/endpoints?service_id=45583fd23b6c40b18175164914e5040e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:54.664929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:54.818305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26248b2-2991-4c1c-8606-a78ddf5115d0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:54.868030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:54.869506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:54.869994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:54.870491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:54.871378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:54.873563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bd8b2-31dd-49b7-ba7c-20878cf6e406 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:54.882481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 400/780] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:00:54 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:55.301357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8cce-ad8e-479e-896e-27c08afcd930 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.301861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8cce-ad8e-479e-896e-27c08afcd930 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.301934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8cce-ad8e-479e-896e-27c08afcd930 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.303594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 381/781] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:55.309051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.309341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.309617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.327730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183979-24ad-40aa-a1d5-96ec6d29521c None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.328026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183979-24ad-40aa-a1d5-96ec6d29521c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.328282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183979-24ad-40aa-a1d5-96ec6d29521c None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.329793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 382/782] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:00:55.334732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.335021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.335303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.338848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:55.340071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:55.362248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:55.363440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:55.465248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 401/783] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:55.489716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:55.493197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 383/784] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:00:55.542057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:55.647659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e80c80-10ce-45b4-82db-c1810834e879 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:55.692920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831437-8c63-4886-9cdb-b1d3fc78ecf5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:55.726089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:55.727914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.728197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.728470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.736505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:55.737329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.737606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.737876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.754865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:55.761888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:00:55.763101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 402/785] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:00:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:55.764049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:55.771527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:55.773132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 384/786] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:55.776898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:55.779190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:55.890189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3ce4-4768-4afb-8af8-795e42bfd676 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:55.940801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:55.941490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:55.941777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:55.942048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:55.942970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:55.943439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:55.944985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:55.963016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 385/787] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:55.969423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:55.984068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0ca0-3a4a-44a4-b413-3cda14b8d7ee None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.020612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.021754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.022241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.022738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.023706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.024799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.026388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.035911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 403/788] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:00:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.043213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.160335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2681aa-e2b3-4c4c-9b54-c22f4cdb95bb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.162469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712213-9aae-4167-8eec-8b3986b6f990 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.202638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.204333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.204918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.205368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.207926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.208907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.209186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.209551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.217672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.219614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.224431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.226470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.236698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-57d394ae-2e4f-455b-8b1e-ee0d3be16b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:56.242601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 386/789] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:56.244046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2150772-225c-494e-a028-a5951ece9f9c None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.244470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2150772-225c-494e-a028-a5951ece9f9c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.244847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2150772-225c-494e-a028-a5951ece9f9c None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.245831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-dea4c609-8708-4cc1-979a-d9a8a5b24adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:56.246565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 387/790] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:56.247344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2150772-225c-494e-a028-a5951ece9f9c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.252691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 404/791] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:56.252816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.253393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.253393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.273076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:56.275589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:56.351223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 405/792] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:56.352494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.355120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2150772-225c-494e-a028-a5951ece9f9c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.391143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.391918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.392197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.392470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.393465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.394037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.395463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.407751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 388/793] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.408577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.457234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc5445-5463-4c66-93a5-86d43b813292 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.491988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.492960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.493447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.493919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.494853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.495369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.496949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.507118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4babf2-227c-43f6-a121-34361d73f5bb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.513398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 406/794] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.514572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.541467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.542532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.542956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.543386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.554599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:00:56.562413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:00:56.564134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 389/795] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:56.565089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.619726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5dbd-a111-43c9-8927-96e37bb4670d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.654134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.655213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.655322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.655720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.663398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.664983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.670358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0636f-36d5-4c9d-b218-93dbacf534b8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.678643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:00:56.680289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 407/796] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:56.681261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.707684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.708756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.709181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.709593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.717681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.719457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.734427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:00:56.740543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 390/797] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:56.741559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.783078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff209a4-ac45-45a8-accc-982c4173c68e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.817612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.818467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.818743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.819092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.819969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.820349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.821816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.831118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 408/798] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.832062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.845773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081628e9-3f66-407b-9bc3-11ace70d6319 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.879299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.880283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.880738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.881183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.882211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.882704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.884424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.906249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 391/799] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.907453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:56.933600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441f4c-41a9-41e9-8486-16bbc4994406 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:56.968478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:56.969151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:56.969435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:56.969715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:56.970547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:56.970857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:56.972329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:56.989212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 409/800] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:56.990816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.016158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f4102-c97b-4bc9-beb7-96e89ddc429d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.058678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.059553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.059844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.060125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.072212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.073810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.094243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ead6ab6f-18f9-4b4b-8535-45b79708937b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:57.100109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a9bc-0521-4c3f-95a8-023d9ad8e360 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.100235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 392/801] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.101279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b139d-8b80-4d75-b458-dc5e7a790891 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.101567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b139d-8b80-4d75-b458-dc5e7a790891 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.101843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b139d-8b80-4d75-b458-dc5e7a790891 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.103250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 393/802] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:57.107861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b139d-8b80-4d75-b458-dc5e7a790891 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.133556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.134350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.134631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.134903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.145388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.146926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.163720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:57.169462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 410/803] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.169462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.218941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b139d-8b80-4d75-b458-dc5e7a790891 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.255564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.256669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.256953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.257225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.267799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.269241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.272103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621fdf-5df6-4f4f-9b59-39f5456e4531 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.286029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e6668d45-721d-4fa5-9765-07610dcc5643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:57.291715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 394/804] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.291715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.291715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.291715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.305047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:57.306244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:57.313454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.314466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.314755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.315031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.316155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:57.316472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.318410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.331194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 411/805] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:57.332047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.380633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 395/806] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:57.381583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.441509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c17a-aaa5-467e-bb8e-131c6668a784 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.475292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.475989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.476275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.476555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.477270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:57.477584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.478948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.495237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 412/807] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:57.495237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.506032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca216b8-c8a9-4005-a96f-2dea7617dca6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.543676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.544345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.544632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.545443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.546168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:57.546478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.547917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.563968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 396/808] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:57.563968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.594197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbeb43-144e-45f0-8121-713a5ad49b38 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.627274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.628079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.628360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.628631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.635242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.636715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.650158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:00:57.651300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 413/809] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.652074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.660318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c989-715c-43e3-bafc-8160d86d432e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.693939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.694809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.695089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.695359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.696110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.697480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.708571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 08:00:57.709733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 397/810] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.710486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.754870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b30af-e70b-4610-88b1-097aec1cb612 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.786493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.787277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.787588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.787866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.794319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.796295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.802236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942287a1-5e04-42d6-b152-ae14422d72cf None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.809210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-63574622-26a6-4536-b581-3bcac3134160 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:57.810414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 414/811] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.812169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f948-158a-4a98-90f4-58debb07891e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.812464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f948-158a-4a98-90f4-58debb07891e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.812741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f948-158a-4a98-90f4-58debb07891e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.814185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 415/812] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:00:57.816078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43f948-158a-4a98-90f4-58debb07891e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.835134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.835942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.836222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.836490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.843428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.844878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.858426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:57.859589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 398/813] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:57.860333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.910897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43f948-158a-4a98-90f4-58debb07891e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.942530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.943186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.943491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.943776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.944596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:57.944905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.946311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.953090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288864a-4ce2-4263-a732-c09930751cdd None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:57.962437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 416/814] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:57.963222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:57.986986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:57.987687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.987972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.988251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:57.988961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:57.989269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:57.990631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea4a6-2a56-4f4d-b5f1-dfd379396cb8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:57.995054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 399/815] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:57.996366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:57.996652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:57.997197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.012309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:00:58.013500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:00:58.061199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcb1b-7f23-41b1-9597-ebd8d8b8ff3c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.075295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 400/816] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:00:58.076321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.093746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.094400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.094684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.094962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.095785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:58.096099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.097531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.109471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 417/817] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:58.110325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.170302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ecd42-c0d7-4fc8-90d4-6cfa5e67501c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.202879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.203559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.203842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.204111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.204203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6813-4e70-48b6-a197-eb26110344dd None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.204885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:58.205188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.206602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.217446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 401/818] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:58.218231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.236724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.237368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.237652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.237933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.301570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.303018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.309826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead22c4-9786-4252-a7b1-05dbd5759ed9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.340990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.341583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.341875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.342143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.342827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:58.343128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.344497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.350008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 402/819] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:58.350883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.396224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 418/820] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:00:58.397116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.451280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345684cd-2351-4cc8-9cc4-2cb050489b85 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.482826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.483641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.483929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.484202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] PATH_INFO: `/v3/services/network` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.484849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.486228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.488258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae82f-962e-4495-a037-edd38ac5b932 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.497020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 08:00:58.498823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 403/821] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:58.499614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.519955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.520828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.521107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.521375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/a35f5b8f9e834adb8d67eb2b6fb4ec62/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.523268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=a35f5b8f9e834adb8d67eb2b6fb4ec62, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.524967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.582919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 419/822] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:58 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/a35f5b8f9e834adb8d67eb2b6fb4ec62/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:58.583714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.594574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b97c5-e840-4d86-bd7d-65f273f94d25 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.632505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.633417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.633756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.634033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/dc77bc705e44486fa93db5f88ccaa7b4/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.652835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=dc77bc705e44486fa93db5f88ccaa7b4, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.654864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.696855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a768e-4cbf-463b-ad5e-16ecdb13e5d3 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.731770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 404/823] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:00:58 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/dc77bc705e44486fa93db5f88ccaa7b4/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:00:58.733374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.733498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.734133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.734422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.734754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.735562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.737069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.814830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 420/824] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:00:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:58.820155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.860220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca68c4-b9e0-4723-8e9b-2fa8c3071e01 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:58.910413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:58.913174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:58.914559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:58.917979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:58.931757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:58.933592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:58.955899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:00:58.957896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 405/825] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:00:58.963202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:58.978432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfef62-3920-4f0c-87e8-31501afa3bb4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.022789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.023490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.023777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.024053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.025032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:59.025342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.027363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.034584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 421/826] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:59.039647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:59.090341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3648f-e0e0-4aa6-bfa4-c0fa3a348dd3 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.129521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.130146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.130577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.130946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.131806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:59.132207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.133650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.146548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 406/827] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:59.149040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d86ee-57d0-4fc6-adcf-5e398a851ac9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.152799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:59.186764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.187285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.187606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.187881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.189297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] RBAC: Adding query filter params (type=network) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:59.189297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.192401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.200861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 422/828] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:00:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:00:59.206862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:59.273866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf32cf1-6beb-444e-a528-20a8887e526a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.309362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.310170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cafe4-7040-4206-ade9-15563f9ebb54 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.311318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.311920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.312439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.319683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.321464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.336263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:00:59.340188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 407/829] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:00:59.346042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:59.346402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.347142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.347419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.347722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.348706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.350086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.442910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 423/830] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:00:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:00:59.456779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929b32-dd12-4ccc-8df6-7c2d675b5ca7 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.511364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.512048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.512327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.512596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.513432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:59.514329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.515780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8f5e-7620-4a1a-918d-57e6e8174495 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.533345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 408/831] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:00:59.538964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:00:59.661389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6de3a-5602-48bc-888d-068a2c35a76e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:00:59.705137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:00:59.705722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:00:59.706004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:00:59.706278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:00:59.707118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:00:59.707428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:00:59.708909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a3370-ba01-4739-af9b-4d6b10268d68 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:00:59.715809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 424/832] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:00:59 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:01.030568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc94f-86e6-4808-bfbf-23b665621e56 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.031628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc94f-86e6-4808-bfbf-23b665621e56 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.032133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc94f-86e6-4808-bfbf-23b665621e56 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.033957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 409/833] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:01.039537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.040402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.040876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.057910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:01.059420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:01.125854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 425/834] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:01.150611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc94f-86e6-4808-bfbf-23b665621e56 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.259600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc94f-86e6-4808-bfbf-23b665621e56 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.292819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.294077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.295105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.295618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.305906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:01.313802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-9a5a7145-01a7-4760-9e25-459ed8dbefa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:01:01.315505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 410/835] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:01.321366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.358689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87cec-942f-4be0-a81f-8a2fcce54fa5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.359321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87cec-942f-4be0-a81f-8a2fcce54fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.359846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87cec-942f-4be0-a81f-8a2fcce54fa5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.361638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 411/836] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:01.366883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.367159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.367441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.388978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:01.390162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:01.425076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0f6ad-9c0e-4c35-a711-6a33d6f92295 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.459119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.460057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.460410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.460745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.461594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:01.461970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:01.463429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:01.473151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 426/837] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:01.478573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.481685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 412/838] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:01.506808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.604795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0c3d-9fe5-43dd-826d-11cf481dc5b0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.616097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca9e7a-a4e4-4ab6-b80a-965e7951d5c7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.640101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.640920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.641203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.641476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.648874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.650150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.650637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.651091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.652312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:01.653731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:01.662116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:01.669166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c8cceb81-e235-4ed1-89bd-79b4c55993de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:01:01.675517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 413/839] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:01.675667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:01.675792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065335-e73c-40a8-809b-de706609f30d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.675792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065335-e73c-40a8-809b-de706609f30d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.675792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065335-e73c-40a8-809b-de706609f30d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.676009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 427/840] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:01.677091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.678024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 414/841] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:01.678919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065335-e73c-40a8-809b-de706609f30d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.780500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065335-e73c-40a8-809b-de706609f30d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.794218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4222-adc8-4fff-b2b3-b8dcfa2a13d2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.816855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.817519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.817803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.818073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.818819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:01.819126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:01.820532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf857-a52f-4aed-9549-83059aea0124 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:01.830716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.831406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 415/842] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:01.831767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.832198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.832616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.832714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.832906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.833180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.833834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:01.834280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:01.836040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:01.846926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 428/843] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:01.847924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.856363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:01.858335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:01.923710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 416/844] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:01.924854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:01.953421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55c0bd-a4fb-4e5f-b81d-ac52b9efe18b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:01.986060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:01.986853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:01.987127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:01.987403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:01.995119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:01.996585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.009722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 08:01:02.016251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 429/845] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.016251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.035011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489f69-a3bf-49ea-b175-aca9a3af3f3d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.067548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.068163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.068490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.068704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.079058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.080520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.097926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:02.103806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 417/846] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.104776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.112543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2906-7f1d-4bb7-8752-ebbcfa64b4d2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.145590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.146381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.146662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.146939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.147610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.148964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.160846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 08:01:02.162014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 430/847] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.162767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.211299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fcf4b-487e-41ff-b40a-01339c85a85c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.243284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.244055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.244338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.244615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.245445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:02.245752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.247167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7292b-82e9-4747-9aaf-efd5306ba6cd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.256769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a276-28eb-41de-afa2-8d2adc3392df None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.263146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 418/848] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:02.264907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23e34-eb0c-4ddc-ba2e-96ee2c08394d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.265191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23e34-eb0c-4ddc-ba2e-96ee2c08394d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.265469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23e34-eb0c-4ddc-ba2e-96ee2c08394d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.266965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 419/849] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:02.267664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b23e34-eb0c-4ddc-ba2e-96ee2c08394d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.290582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.291246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.291560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.291841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.292552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:02.292858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.294255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.305341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 431/850] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:02.306120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.363664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b23e34-eb0c-4ddc-ba2e-96ee2c08394d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.396225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.396882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.397168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.397418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245559c0-fa85-4675-8eae-e4b4f182ff66 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.397525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.398135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:02.398446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.400093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a3c03-305a-43ea-8c25-b10d515b1b74 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.404407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 420/851] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:02.405651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.405938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.406233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.422652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:02.423826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:02.429704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.430349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.430636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.430915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.485960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 421/852] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:02.486794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.497572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.499550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.588773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f604b10-3422-4b5a-91b5-1e38b0608a9d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.592081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 432/853] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:02.592905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.621088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.621824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.622104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.622376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.629560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.630987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.645635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:01:02.646797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 422/854] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.647566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.687372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561d53-ccf8-4b0f-a236-4ca9e45b9ce6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.719109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.719802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.720078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.720349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.721046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:02.721347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.723361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.728330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 433/855] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:02.729123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.741770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5fc1d-a73d-45eb-ad73-95b34acc4f33 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.781786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.782613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.782900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.783175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.783861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.785251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.797625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 08:01:02.799090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 423/856] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.799700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.862416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa52-d414-47a0-bbd4-1c8b5b05f226 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.898895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.899994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.900278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.900554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.902657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01446a-8354-4246-9342-1e3290440ab0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:02.911451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.912954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.931361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:02.932869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 434/857] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:02.933645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:02.940346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:02.941014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:02.941294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:02.941567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:02.942399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:02.942710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:02.944174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:02.961557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 424/858] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:02.966733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.030874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bf85-700d-4869-a0cf-07fe346f7252 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.060165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ca4d-2814-4317-8914-5a83b975c579 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.064164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.064825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.065104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.065375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.066076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.066378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.067756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.077629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 435/859] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:03.077629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.094227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.094886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.095168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.095442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.096182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.096487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.097838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.113729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 425/860] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:03.113729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.190397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84952e-7ec7-4e07-bd61-4f822b72bd78 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.217187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26478ce-2196-419c-86eb-0f587a005e70 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.227610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.228258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.228564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.228806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.249309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.249969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.250250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.250524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.251309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.251648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.253006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.257307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 426/861] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:03.258061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.319271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.320829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.385136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e7cd-1a0f-4560-8770-0e2157f28ec0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.425479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.427212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.427836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.428317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.436111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.438041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.438256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 436/862] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:03.439277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.453398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:03.454973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 427/863] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:03.460715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.544218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf1e0f-776b-49e1-ae41-1c3c883130ed None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.585171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.585971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.586258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.586535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.586749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d781f8-746d-43b9-a8b2-46e9ee9dc948 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.599042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.601113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.622283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:03.623873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 437/864] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:03.624520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.625231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.625520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.625799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.626593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.626905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.628446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.628923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.647568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 428/865] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:03.651347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.746058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c62f-d973-4956-a16a-6ae54839a0a4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.777686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406d0d-602a-4468-abc1-fb19b71a9548 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.780131 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.780791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.781071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.781343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.782780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.782780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.783710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.799729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 438/866] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:03.800600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:03.820936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.822338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.823062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.823541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.825026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:03.826280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.828162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.843500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 429/867] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/role_assignments?user.id=a35f5b8f9e834adb8d67eb2b6fb4ec62&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:03.915107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8533e6-f9b3-455e-8a81-ed57c43f8ce0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:03.950386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:03.951812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:03.952092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:03.952369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:03.959823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:03.961344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:03.976372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:03.977963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 439/868] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:03.984014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:04.092229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d94c5-ed31-4542-bc99-01a070311b0c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:04.125771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:04.126432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:04.126711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:04.126993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:04.127809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:04.128117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:04.129545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992bc80-6f04-4bf6-8865-fdb140662d05 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:04.142934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 430/869] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:04.148814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:04.251756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0c6d-bf32-4cbf-b102-5e0ac6988260 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:04.284694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:04.285531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:04.285839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:04.286122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:04.286946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=dc77bc705e44486fa93db5f88ccaa7b4) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:04.287300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:04.288757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94518b-f60f-462a-9363-4dad4e2de24c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:04.295958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 440/870] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:04 2022] GET /identity/v3/role_assignments?user.id=dc77bc705e44486fa93db5f88ccaa7b4&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:05.072394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fd1-eb12-4f28-8596-2876f6148a35 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.072780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fd1-eb12-4f28-8596-2876f6148a35 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.072988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fd1-eb12-4f28-8596-2876f6148a35 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.074508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 431/871] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:05.080758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d352-a3cd-4512-92ba-d14baa448194 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.081301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d352-a3cd-4512-92ba-d14baa448194 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.081772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d352-a3cd-4512-92ba-d14baa448194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.099874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e633d352-a3cd-4512-92ba-d14baa448194 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:05.101442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e633d352-a3cd-4512-92ba-d14baa448194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:05.174957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 441/872] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:05.201614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6006fd1-eb12-4f28-8596-2876f6148a35 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:05.306698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6006fd1-eb12-4f28-8596-2876f6148a35 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:05.340940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:05.342484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.342964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.343432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.344425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:05.346003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd19c-968b-4c5e-952b-b7bb7aa76988 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:05.431774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 432/873] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:05 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:05.601452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2933c-c9ae-4360-87d9-969f49f89d28 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.601954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2933c-c9ae-4360-87d9-969f49f89d28 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.601954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2933c-c9ae-4360-87d9-969f49f89d28 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.603604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 442/874] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:05.609225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9f8d-821e-4b49-b709-c42d80915a19 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.609466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9f8d-821e-4b49-b709-c42d80915a19 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.609676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9f8d-821e-4b49-b709-c42d80915a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.627209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4ffe9f8d-821e-4b49-b709-c42d80915a19 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:05.628487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4ffe9f8d-821e-4b49-b709-c42d80915a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:05.702776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 433/875] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:05.726159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2933c-c9ae-4360-87d9-969f49f89d28 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:05.830105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2933c-c9ae-4360-87d9-969f49f89d28 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:05.865644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:05.866244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:05.866577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:05.866862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:05.867622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:05.869007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686cc5-29c1-4f23-9c9e-bdfc8c2141c9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:05.942744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 443/876] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:05 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:06.337440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae442-4c4d-41fc-a7d0-f60ead9e5bec None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.338382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae442-4c4d-41fc-a7d0-f60ead9e5bec None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.338964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae442-4c4d-41fc-a7d0-f60ead9e5bec None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.340879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 434/877] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:06.346835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.347380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.347909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.367273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:06.368948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:06.444575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 444/878] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:06.468046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae442-4c4d-41fc-a7d0-f60ead9e5bec None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:06.570142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae442-4c4d-41fc-a7d0-f60ead9e5bec None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:06.607688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:06.608938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.609421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.609938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.610807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:06.612424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:06.624537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-1893a08f-59fe-4594-946f-8420aee58e79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 08:01:06.626319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 435/879] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:06.633731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:06.736926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94d2fa-1000-4795-8342-bfe465fa24ed None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:06.742774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3000c9-e4df-4e27-b375-9a230e7a796e None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.743059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3000c9-e4df-4e27-b375-9a230e7a796e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.743337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3000c9-e4df-4e27-b375-9a230e7a796e None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.744981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 436/880] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:06.749925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.750209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.750534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.767654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:06.768873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:06.778348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:06.780225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.780889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.781494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.782558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:06.783079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:06.785277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:06.791768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 445/881] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:06.797506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:06.847611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 437/882] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:06.863905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:06.898009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211463ce-0b30-4cd9-8618-08f865a6913e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:06.932015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:06.933056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:06.933542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:06.934017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:06.935453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:06.936001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:06.937556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:06.947564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 446/883] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:06.965096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de5f5e-e8b1-4d06-9013-d930c9b42898 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.003564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.004492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.004779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.005053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.018030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:07.026356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:07.027976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 438/884] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:07.034100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.140534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c86fb-c705-4be7-8751-7c3ff8478374 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.187271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.188051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.188334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.188627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.189428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:07.189792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:07.191109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:07.199855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 447/885] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:07.206158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.305826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f3a-97d7-4152-a7a3-3d74b455af46 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.340011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.340810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.341114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.341450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.352464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:07.354115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:07.371509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:07.373679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 439/886] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:07.380925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.488787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b6f8-7f20-42da-aae1-f8973134b155 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.526514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.527610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.528114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.528628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.529574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:07.530093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:07.531802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:07.545044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 448/887] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:07.551589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.650660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900bdbd-3b53-4a70-909b-a4604efe5977 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.684930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.685738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.686017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.686289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.694767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:07.696233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:07.710065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d593d52d-bc23-4214-b475-025cfbdc5b7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:01:07.715712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 440/888] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:07.717788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.771118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e894dd-0d09-4e38-bbbd-a5b80e2339cc None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.771457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e894dd-0d09-4e38-bbbd-a5b80e2339cc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.771742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e894dd-0d09-4e38-bbbd-a5b80e2339cc None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.773451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 441/889] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:07.782140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.782677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.783177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.800686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:07.802262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:07.829092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4d4c-aeb3-4fba-ba54-224b7ed57697 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:07.874390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:07.874802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 442/890] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:07.875114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:07.875398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:07.875697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:07.876584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:07.876886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:07.878294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:07.894205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.896536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 449/891] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:07.903116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:07.999171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfd5ce-c2af-4af3-94d2-e0903be57efb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.003779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884f49-86f3-472c-8428-0060a925e410 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.034528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.035725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.036219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.036694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.037570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.038353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.039003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.039284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.039596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.040033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.051643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 08:01:08.057946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 443/892] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:08.059445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.107360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.108844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.159526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb75e-eb21-48ca-8a09-d1f5af7ce6c2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.202575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.203572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.204077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.204553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.205449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:08.205949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.207541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.217800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 444/893] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:08.218636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 450/894] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:07 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:08.219565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.219919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.315691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a638-7cfa-4620-b6bc-888c75ba8f89 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.317080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a697-ceaa-4f7f-90ee-9a41ed1b7f55 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.349813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.350016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.350447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.350735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.351037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.351767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:08.352073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.352329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.352803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.353281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.353444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d658a-d3f9-4f0b-886e-d2ae510b2f70 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.358311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 445/895] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:08.359921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd7f2f-ab76-4f50-9834-b8236bce0361 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.360266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd7f2f-ab76-4f50-9834-b8236bce0361 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.360544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd7f2f-ab76-4f50-9834-b8236bce0361 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.363620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 446/896] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:08.363873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd7f2f-ab76-4f50-9834-b8236bce0361 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.369251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.370702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.389183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-b546c716-8195-49b6-b562-016dd27981b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:08.394940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 451/897] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:08.394940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.394940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.394940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.410096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:08.411199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:08.471123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd7f2f-ab76-4f50-9834-b8236bce0361 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.487573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 452/898] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:08.487573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.519204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.519975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.520269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.520549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.521334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] RBAC: Adding query filter params (interface=public, service_id=1b486b32e47f4004850d88851215b851, region_id=RegionOne) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:08.521637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.523067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.528147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 447/899] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/endpoints?service_id=1b486b32e47f4004850d88851215b851&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:08.532369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.574118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d12f6-83f4-48b1-a02e-d67876a26e4e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.606980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.607684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.607968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.608243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.608961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:08.609263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.610617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.622219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 453/900] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:08.623708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.632549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de2771-f4e5-4302-a930-b26ce2256946 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.667387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.668178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.668458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.668730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.669409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.670790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.684523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 08:01:08.690823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 448/901] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:08.690823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.720683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa0f2-58a7-4ee2-be74-0485006b78a3 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.753861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.754520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.754797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.755068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.755760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.757117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.762533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 454/902] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services => generated 1268 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:01:08.763872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.805420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e446a-0254-4a4f-85c3-1304c9642f76 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.842979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.844188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.844667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.845124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.852924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.854706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.869672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:08.871653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 449/903] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:08.883518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:08.883726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e016ab-78c1-4ccb-b16e-c14e15d1ca35 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:08.926562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:08.927277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:08.927653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:08.927998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:08.928788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:08.929165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:08.930626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:08.941791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 455/904] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:08.943788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:09.018479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ad5e5-50dc-4899-aa43-730548e067d0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.061727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.062398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.062681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.062956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.063784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:09.064257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.065240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b0fe-467f-4de4-8ef1-289bcece4bb1 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.065763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.085438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 450/905] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:09.086938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:09.108271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84199-512b-49f3-82de-306364d34825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.108935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84199-512b-49f3-82de-306364d34825 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.109261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84199-512b-49f3-82de-306364d34825 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.109533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84199-512b-49f3-82de-306364d34825 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.110287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84199-512b-49f3-82de-306364d34825 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:09.110590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84199-512b-49f3-82de-306364d34825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.112713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84199-512b-49f3-82de-306364d34825 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.119518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 456/906] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:09.125757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84199-512b-49f3-82de-306364d34825 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:09.208590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577b3-bcb9-416d-8938-b88f44dff092 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.242464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.243166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.243450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.243743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.244612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] RBAC: Adding query filter params (role.id=86554916c99748188123b811fbc87e69, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=dc77bc705e44486fa93db5f88ccaa7b4) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:09.244928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.246393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.257453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 451/907] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:09 2022] GET /identity/v3/role_assignments?user.id=dc77bc705e44486fa93db5f88ccaa7b4&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=86554916c99748188123b811fbc87e69 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:09.258997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84199-512b-49f3-82de-306364d34825 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.297521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.298582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.299067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.299600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.300603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] RBAC: Adding query filter params (interface=public, service_id=46d6880dec544e2a81f6c0d9f1e8e3e8, region_id=RegionOne) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:09.301126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.302720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24ea0-5c42-4feb-8c22-ae8f7fd4436f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.309198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 457/908] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:01:09 2022] GET /identity/v3/endpoints?service_id=46d6880dec544e2a81f6c0d9f1e8e3e8&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:09.317459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:09.370521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02aefd-b2e9-41a2-aa9b-dd94e51fb56f None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.370853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02aefd-b2e9-41a2-aa9b-dd94e51fb56f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.371090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02aefd-b2e9-41a2-aa9b-dd94e51fb56f None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.373345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 458/909] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:09.379029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.379331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.379645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.397443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:09.398657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:09.431488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b9936-7ea5-4a83-be8c-6a3264f6c171 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.476701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.477306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.477593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.477868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.478555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.480024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f846-749c-41c7-918d-c8ce740a6385 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.481211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 459/910] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:09.492114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 452/911] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:09 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:01:09.506712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:09.619728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425db9e-6b0a-48b7-9979-fc041aeb13ba None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:09.656206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:09.656897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:09.657180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:09.657519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:09.658253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:09.659745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f325803-6da1-4412-89aa-c8fc71fbbf21 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:09.722450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 460/912] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:09 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:11.131990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ad18-4557-494d-a158-090aefb17a21 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.132532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ad18-4557-494d-a158-090aefb17a21 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.132532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ad18-4557-494d-a158-090aefb17a21 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.134205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 453/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:11.139311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.139733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.139920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.158251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:11.159424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:11.232809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 461/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:11.257350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ad18-4557-494d-a158-090aefb17a21 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.364907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ad18-4557-494d-a158-090aefb17a21 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:11.399584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:11.400763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.401238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.401708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.402559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:11.404177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:11.415594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 08:01:11.417419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 454/915] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:11.427493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.527218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031819b-13d5-41f6-aacf-fade69d7c1f6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:11.562360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:11.563029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.563307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.563604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.564299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:11.564603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:11.565952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dc49-d231-4b9f-97da-dd4a1abb4475 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:11.571127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 462/916] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:11.576665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.642401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd9a-f609-4bb0-ae44-9a695a4856bf None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.642719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd9a-f609-4bb0-ae44-9a695a4856bf None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.642945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd9a-f609-4bb0-ae44-9a695a4856bf None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.644606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 463/917] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:11.649894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.650421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.650912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.670200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:11.671750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:11.685696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495602a0-08a3-4944-87f0-d5c63c6b56cb None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:11.726962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:11.728115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.728605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.729141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.730070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:11.730582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:11.732246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:11.738149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 455/918] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 12 08:01:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:11.744917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.767614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 464/919] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:11.784197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.848038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00609-410d-4b1f-9e82-1bdc7ac18338 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:11.881419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:11.882077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.882364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.883060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.883990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:11.885673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045893-5381-4dce-a924-905b3a18160f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:11.894672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e0ac-d20b-4f46-90b5-9f90e615fb3e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:11.928287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:11.929046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.929306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.929575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.939502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:11.946937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c40c3114-b60a-494a-b6f6-d655f43ef996 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:11.948190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 465/920] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:11.953626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5431d-63b5-4e77-8d5f-1320bfdedfe2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.953626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5431d-63b5-4e77-8d5f-1320bfdedfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.953626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5431d-63b5-4e77-8d5f-1320bfdedfe2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.953626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 466/921] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:11.954508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5431d-63b5-4e77-8d5f-1320bfdedfe2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:11.963239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 456/922] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:11.965302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd014-05f3-4fe4-a26a-293e097f0eb0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:11.966802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd014-05f3-4fe4-a26a-293e097f0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:11.967326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd014-05f3-4fe4-a26a-293e097f0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:11.990589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-bf1bd014-05f3-4fe4-a26a-293e097f0eb0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:11.992225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf1bd014-05f3-4fe4-a26a-293e097f0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:12.069054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5431d-63b5-4e77-8d5f-1320bfdedfe2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.091545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 457/923] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:12.093240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d17e-2bcd-42c4-aec0-56a2cc25d8f2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.093904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d17e-2bcd-42c4-aec0-56a2cc25d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.094364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d17e-2bcd-42c4-aec0-56a2cc25d8f2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.096213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 458/924] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:12.101715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.102006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.102281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.114492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.115636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.116142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.116617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.117622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.118134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.119842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.121565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:12.123317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:12.130190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 467/925] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.131371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.193841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 459/926] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:12.195632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.247270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022d42-4374-41e5-a03b-e9df536741c2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.280694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.281501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.281779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.282052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.282690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.284077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.293551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbf7cc-dc15-4ee8-a6a9-b94cf92e6507 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.295792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 08:01:12.297127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 468/927] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:12.297706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.329240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.330035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.330327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.330601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.340693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.342702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.362623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:12.369101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 460/928] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:12.369101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.394691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f89df-589a-4aa6-a036-888a93d58588 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.428284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.429091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.429378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.429654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.430301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.431705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.444124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 08:01:12.451583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 469/929] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:12.451583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.483994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175726f-caf2-46fc-a9ec-3dd34ceb8338 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.523752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.524850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.525340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.525754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.526828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.527300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.530010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.540231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 461/930] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.540231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.552376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08245503-820e-4699-93fe-3b7e51c3fecb None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.584680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.585342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.585650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.585935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.586652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.586969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.588356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.604529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 470/931] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.604529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.638523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc052e-9be2-4918-b31e-15792b3beb5f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.670834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.671523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.671814 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.672090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.672794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.673098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.674466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.683554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 462/932] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.683554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.705874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674e40-5958-475a-97fe-1b357988b4b3 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.740316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.740990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.741281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.741561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.742263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.742572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.743975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.748669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 471/933] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.748669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.787188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dedec-e535-435c-8991-d5ac7e796b75 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.819415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.820266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.820550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.820825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.830672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.832166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.851233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:01:12.859249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 463/934] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:12.859249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.863498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24eec5-6e12-4854-ae01-1e5a967d76b2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.902531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.903383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.903709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.904277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.904987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:12.905297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.907071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:12.918364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 472/935] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:12.918364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:12.952843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2470b-3169-4be8-883a-a0324b490041 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:12.985056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:12.985978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:12.986342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:12.986621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:12.987363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:12.988774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.014994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327e5ef-0c15-4f5f-84ad-3ff6c4ac2027 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.047840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.048508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.048789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.049065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.049893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:13.050200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.051726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.068842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 473/936] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:01:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:13.069648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.103512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 464/937] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:13.103512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.194562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d55a1-a275-4370-ba6f-7f237e319d2c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.237640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.238282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.238577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.238858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.239693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] RBAC: Adding query filter params (interface=public, service_id=2deae29d71bc4616bd188fa036d1423a, region_id=RegionOne) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:13.240016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.241412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.244925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66f9a-7f77-4c64-897e-4c723cb92fe9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.247939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 474/938] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/endpoints?service_id=2deae29d71bc4616bd188fa036d1423a&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:13.253728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.286868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.287717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.287992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.288269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.300446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.301919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.320232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:13.321744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 465/939] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:13.327103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.363099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc79ac9-72ad-4fce-8208-c473acc88290 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.403948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.404952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.405247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.405800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.406486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.408641 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.416722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 475/940] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:01:13.453599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f964f-8f53-47b7-bd1e-f95445695d04 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.491336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.491973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.492259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.492537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.493276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:13.493585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.495005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.509187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 466/941] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:13.516652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.634807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60317-ed8b-4af0-8947-ad1fdbbfeb91 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.668364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.669212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.669501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.669776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.676526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.678085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.693010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:13.694533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 476/942] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:13.700210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.804581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9a1a7-ce34-4323-9f5e-4938a5e1581b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:13.838299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:13.839023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:13.839313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:13.839623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:13.840464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:13.841307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:13.842751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460978-5e14-4c43-a8b8-fceca2f0a1ff None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:13.854604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 467/943] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:13.860915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:13.962445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fcfc9-a11a-416b-bad8-1f901e954dbd None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:14.000067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:14.001201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.001626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.002073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/dc77bc705e44486fa93db5f88ccaa7b4/roles/86554916c99748188123b811fbc87e69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.004462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=dc77bc705e44486fa93db5f88ccaa7b4, role_id=86554916c99748188123b811fbc87e69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:14.006062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4c3a-2a5a-43d0-82f9-976f3335c90a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:14.087732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 477/944] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:01:13 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/dc77bc705e44486fa93db5f88ccaa7b4/roles/86554916c99748188123b811fbc87e69 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:01:14.347267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7363e-2a69-4ce3-aab5-afa6277946c0 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.347267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7363e-2a69-4ce3-aab5-afa6277946c0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.347267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7363e-2a69-4ce3-aab5-afa6277946c0 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.347267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 468/945] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:14.353078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.353756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.353756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.373810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:14.375310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:14.447576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 478/946] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:14.468705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7363e-2a69-4ce3-aab5-afa6277946c0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:14.569228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7363e-2a69-4ce3-aab5-afa6277946c0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:14.602753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:14.603812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.604292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.604790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.605722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:14.607437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:14.609104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.common [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 12 08:01:14.664886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.sql.core [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 12 08:01:14.664886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 12 08:01:14.664886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [parameters: {'id': '26217668565d4c83acf96850ec8b8e9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 12 08:01:14.664886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80257) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 08:01:14.681332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26217668565d4c83acf96850ec8b8e9a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26217668565d4c83acf96850ec8b8e9a. Apr 12 08:01:14.687575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 469/947] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Apr 12 08:01:14 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:14.690131 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:14.789923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed0e4d-161b-49ed-8843-77d0cf3157b6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:14.824411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:14.826093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.826570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.827069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.834000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:14.835677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:14.849389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-9bf6180e-0b31-495f-bffb-3d750876dff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:14.855738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 479/948] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:14.857536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:14.958948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a1d0-e78b-4e6a-bc4d-737c8b75d9d9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:14.993125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:14.994123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:14.994598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:14.995080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:14.996069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:14.996566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:14.998481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8b46e-ddf0-479b-96b4-9385738a69f7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:15.023497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 470/949] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:15.598025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2220-e184-4fc4-8855-0fefa28b4b95 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:15.598506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2220-e184-4fc4-8855-0fefa28b4b95 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:15.598579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2220-e184-4fc4-8855-0fefa28b4b95 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:15.600243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 480/950] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:15.605357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd537-222f-4935-8de0-ceb7fe87fff9 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:15.605762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd537-222f-4935-8de0-ceb7fe87fff9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:15.605938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd537-222f-4935-8de0-ceb7fe87fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:15.625639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e6ecd537-222f-4935-8de0-ceb7fe87fff9 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:15.627168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e6ecd537-222f-4935-8de0-ceb7fe87fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:15.694429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 471/951] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:15.716916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2220-e184-4fc4-8855-0fefa28b4b95 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:15.815728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d755f-22b7-4146-919f-0948706c3396 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:15.816185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d755f-22b7-4146-919f-0948706c3396 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:15.816567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d755f-22b7-4146-919f-0948706c3396 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:15.818054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 472/952] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:15.823157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:15.823438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2220-e184-4fc4-8855-0fefa28b4b95 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:15.823707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:15.824089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:15.842743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:15.844325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:15.873734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:15.874470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:15.874760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:15.875035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:15.875727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:15.877088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:15.889397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 08:01:15.891197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 481/953] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:15.898577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:15.925912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 473/954] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:15.945541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.020800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733da15f-8c92-4761-b052-4d0c0d030994 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.046192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074d51a-4fc4-4e84-ab16-f813a8c6bdab None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.061522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.062475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.062608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.062809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.063680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:16.063901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.065336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.076154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 482/955] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:16.077196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.091815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.093010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.093837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.094269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.095304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.097282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.111961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 08:01:16.114468 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 474/956] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:16.119881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.183514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e278da-9548-4538-8be8-6b94ee44f45f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.221744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.222350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.222638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.222920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.223738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:16.224075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.225464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.239924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 483/957] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:16.249857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfa20-8946-405f-8001-9b06ffba3481 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.289933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.291012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.291545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.292019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.293016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:16.293531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.295763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ebbb-a1da-4492-930a-a589beff6194 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.302187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 475/958] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:16.308112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.418680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a835b-b619-435c-8e56-cc9a4875a875 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.440944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff05c4-a1aa-4812-be6c-b86bf0d26bfe None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.441244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff05c4-a1aa-4812-be6c-b86bf0d26bfe None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.441423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff05c4-a1aa-4812-be6c-b86bf0d26bfe None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.443053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 476/959] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:16.448023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.448312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.448593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.458586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.459586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.460065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.460593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.461530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:16.462026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.463616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.468854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 484/960] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:16.473919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.486300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:16.488086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:16.571794 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9272-3e1f-4612-a678-ddb2a0e0365a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.575551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 477/961] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:16.603762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.615034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.615722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.616010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.616291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.617342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.619008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.704977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f15b8-b79f-4a86-8b18-c5b25e9a66fb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.707643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 485/962] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:01:16.755726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.756952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.757439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.757960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.769613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:16.778088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:16.780735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 478/963] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:16.788632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:16.893276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83ed6-4ec5-4866-a5a7-b06ca179356f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:16.931757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:16.932436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:16.932718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:16.932992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:16.933808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:16.934115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:16.936158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:16.944645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 486/964] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:16.950763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.058904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676f63-50ad-40af-8031-4e39504ab35e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.093549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.094872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.095338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.095825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.109168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.110968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.129663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:17.131184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 479/965] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:17.136947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.242276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5b03-a881-4b18-90af-e09523e3cf0b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.285108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.286053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.286511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.286956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.287907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:17.288390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.289913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.302542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 487/966] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:17.308322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.412647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c35ca-fca9-4df3-b9ff-4f6c6598a755 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.446703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.447875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.448363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.448843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.457308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.458944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.473579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-b725cf18-4064-4612-8fc6-5c2a17f68d6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 08:01:17.475311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 480/967] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:17.481316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.489035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e05d-56c3-432b-aa05-8313b89da6dd None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.489322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e05d-56c3-432b-aa05-8313b89da6dd None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.489600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e05d-56c3-432b-aa05-8313b89da6dd None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.491208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 481/968] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:17.496019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.496308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.496589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.514009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:17.515203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:17.600260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d75cc1-be51-49b8-83a5-66a2c58d5b80 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.603616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 482/969] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:17.631389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.636842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.638108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.638599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.639089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.640150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:17.640659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.642305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.662043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 488/970] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:17.668091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.736595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cccc95-d4e5-4a97-8a23-9e0e30cc674b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.768520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4668-e600-4133-9ce2-4c2b81108a43 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.770426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.770987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.771269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.771572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.772647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.773708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.804349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.805128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.805455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.805956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.812334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.sql.core [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 12 08:01:17.812334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 12 08:01:17.812334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [parameters: {'user_id': 'e1e9dec05b0d405abf404e0d1002f473', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 12 08:01:17.812334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80257) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 08:01:17.820334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 12 08:01:17.823628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 483/971] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 12 08:01:17 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:17.829999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.881660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.883163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:17.939953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b58c4-ddf2-4a8b-a5aa-dc03052286e4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:17.977148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:17.978343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:17.978856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:17.979337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:17.988488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:17.989616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 489/972] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:17.990567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:17.990950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.008581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 08:01:18.010716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 484/973] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:18.017083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.091748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07e05-8ed1-450b-84d7-6e233eaa1944 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.117907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb8be0-b5e2-4316-9c50-76c086bb481b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.125962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.126819 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.127035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.127303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.138184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.139668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.155691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.156668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.157309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.157493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:18.157955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.158958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:18.159464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.161144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.163440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 490/974] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:18.164283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.216144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 485/975] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 12 08:01:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:18.288365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38caa7-15af-4fa9-bffd-51d4431f89af None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.328004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.328683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.328966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.329244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.329982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:18.330293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.331699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.344991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 491/976] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:18.350911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.458974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e9-450d-4864-b60f-a109733d92c4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.493043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.493940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.494231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.494510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.502253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.503758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.517150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a55bcacf-e646-43ac-b018-87d5ae1d81e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:18.518728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 486/977] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:18.524961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.599455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a870d-2518-4deb-b664-41793a37e9e5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.599827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a870d-2518-4deb-b664-41793a37e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.600061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a870d-2518-4deb-b664-41793a37e9e5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.601581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 487/978] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:18.607157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.607829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.608184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.627511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:18.629148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:18.630288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52f717-85cd-444e-a3e2-75aa6273e113 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.670916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.672078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.672550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.673028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.674439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:18.674981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.676916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.690200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 492/979] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:18.696689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.708925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 488/980] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:18.733079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:18.802204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8743-42ff-484f-b4f8-54beabfc5e89 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.837686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.838340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.838619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.838892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.839738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] RBAC: Adding query filter params (role.id=86554916c99748188123b811fbc87e69, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=dc77bc705e44486fa93db5f88ccaa7b4) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:18.840050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.842075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827ce0-6469-4e5c-ac64-2af391678ccc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.847707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 493/981] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:18 2022] GET /identity/v3/role_assignments?user.id=dc77bc705e44486fa93db5f88ccaa7b4&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=86554916c99748188123b811fbc87e69 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:18.848216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e66e-534a-4b34-b39e-4f7f40c9c028 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:18.884193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:18.884883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:18.885172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:18.885448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:18.886190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:18.888230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5fee-afd4-4feb-a1e7-e3d3c1318fe8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:18.961783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 489/982] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:18 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:01:19.177782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b17bc-c151-4fa2-b184-5e24726de75a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.178155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b17bc-c151-4fa2-b184-5e24726de75a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.178361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b17bc-c151-4fa2-b184-5e24726de75a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.180030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 494/983] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:19.187312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.187639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.187928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.205039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:19.206223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:19.283503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 490/984] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:19.303224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b17bc-c151-4fa2-b184-5e24726de75a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:19.400495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b17bc-c151-4fa2-b184-5e24726de75a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:19.432368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:19.433105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.433387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.433659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.434324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:19.435696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:19.446790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 08:01:19.448130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 495/985] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:19.454494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:19.546614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cd9a7-058c-42cf-94fe-68f39d8b47f4 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:19.579147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:19.579839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.580120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.580395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.581096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:19.581402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:19.582771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:19.592841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 491/986] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:19.594202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:19.689137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c77f-7308-4b06-b4e5-1f0e800778df None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:19.723141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:19.723836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.724116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.724385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.725087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:19.725389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:19.726732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:19.735836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 496/987] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:19.737258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:19.834356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ad83-f84f-4b91-bb08-f6a9f6177214 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:19.865882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:19.866603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:19.866815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:19.867090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:19.867920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] RBAC: Adding query filter params (interface=admin, service_id=2deae29d71bc4616bd188fa036d1423a, region_id=RegionOne) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:19.868238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:19.869603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6f8b-0bce-401f-bb2c-169a10ac4674 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:19.879958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 492/988] 10.222.0.23 () {56 vars in 1249 bytes} [Tue Apr 12 08:01:19 2022] GET /identity/v3/endpoints?service_id=2deae29d71bc4616bd188fa036d1423a&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:19.880744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:19.975301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126240a-20c3-40a7-912a-a93ee86a8104 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:20.007558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:20.008224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:20.008506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:20.008780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:20.009456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:20.010839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331a3e7-116e-44a3-a574-2c57c809868a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:20.017412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 497/989] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:19 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:01:21.214229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab53b6-a9bc-4955-a69a-5396cfa289c9 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.214707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab53b6-a9bc-4955-a69a-5396cfa289c9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.214802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab53b6-a9bc-4955-a69a-5396cfa289c9 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.216847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 493/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:21.221782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.222170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.222339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.240012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:21.241208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:21.294846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294e55-adc0-4e84-9840-f410f940de27 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.295149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294e55-adc0-4e84-9840-f410f940de27 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.295420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294e55-adc0-4e84-9840-f410f940de27 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.297074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 494/991] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:21.301545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.301830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.302107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.307646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 498/992] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:21.318304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:21.319516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:21.329127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.387952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 495/993] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:21.411911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.426374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48865a0-33ba-4050-a942-5032b16a7469 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.460823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.461546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.461834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.462108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] PATH_INFO: `/v3/services/image` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.462751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.464134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.474787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 08:01:21.476138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 499/994] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:21.483530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.507939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd49ef-5f0b-44bb-87d0-5bfa05933314 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.541439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.541981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.542265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.542546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.543203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.545166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.556416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 08:01:21.557770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 496/995] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:21.564053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.580155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fd92-f163-47c3-a643-5b97b9e616ec None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.616323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.617000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.617286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.617567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.618272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] RBAC: Adding query filter params (name=image) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:21.618580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.619987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.625349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 500/996] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:21.630649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.668573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23cf1-9146-4e63-8536-0a87f02c7207 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.701970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.702638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.702919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.703192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.703925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:21.704237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.705637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.710245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 497/997] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:21.716392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.739970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e90b78-8cab-4f9b-bfac-7a22f6d33a27 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.772577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.773244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.773531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.773814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.774774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] RBAC: Adding query filter params (type=image) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:21.775083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.776485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.781369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 501/998] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:21.817147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88ef20-9b05-42b9-90db-b71ce02d6732 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:21.852544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:21.853218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:21.853510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:21.853773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:21.854488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:21.854793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:21.856293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:21.866529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 498/999] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:21.868016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:21.978575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567cef-f5b9-4b4c-90d4-7125c8493c94 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:22.011941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:22.012664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.012946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.013224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.014017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] RBAC: Adding query filter params (interface=public, service_id=86fd29e8f4ba471ab8b9381cbb51307f, region_id=RegionOne) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:22.014331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:22.015716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce078c-1799-43e5-b2b9-36e5ad72ed74 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:22.020982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 502/1000] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:01:21 2022] GET /identity/v3/endpoints?service_id=86fd29e8f4ba471ab8b9381cbb51307f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:22.026601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:22.122055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5708f-30dd-490d-b9f9-cca77a036d2b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:22.154270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:22.154935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.155220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.155522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.156211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:22.157612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658de1-5077-4e25-a9a3-4db30ef77e9e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:22.163865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 499/1001] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:22 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:01:22.336121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053afcc-02b4-4427-afb5-ca11890a7d0e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.336621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053afcc-02b4-4427-afb5-ca11890a7d0e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.336621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053afcc-02b4-4427-afb5-ca11890a7d0e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.337958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 503/1002] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:22.343659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.346085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.346085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.361556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:22.362741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:22.427719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 500/1003] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:22.451229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053afcc-02b4-4427-afb5-ca11890a7d0e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:22.549501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053afcc-02b4-4427-afb5-ca11890a7d0e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:22.582518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:22.583323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.583635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.583909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.584549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:22.585898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:22.597565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 08:01:22.598849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 504/1004] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 12 08:01:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:22.604658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:22.696038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039c35-bbdc-4ea3-a9ce-ba9899bfd722 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:22.727353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:22.728031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.728312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.728581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.729272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:22.729574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:22.730976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:22.735626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 501/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:22.741151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:22.840441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67af18-bf1e-459a-84cc-3066d032eef6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:22.872265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:22.872861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:22.873144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:22.873420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:22.874146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:22.874456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:22.875842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fecf98-b4f2-4d13-8f3f-8bf78a25db27 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:22.880711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 505/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 12 08:01:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:22.886247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:22.985750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfce84-cf3b-4d8a-b36f-78b055c82451 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:23.017933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:23.018586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:23.018866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:23.019140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:23.019911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:23.021281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dd894-d4f2-4221-9159-e18b344ccc40 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:23.110503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 502/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:24.102967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13fcd-0614-40c5-ba82-140ee9cf10de None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.103527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13fcd-0614-40c5-ba82-140ee9cf10de None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.103527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13fcd-0614-40c5-ba82-140ee9cf10de None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.105182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 506/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:24.110840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceecab-4074-476b-849b-127778472096 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.111403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceecab-4074-476b-849b-127778472096 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.111403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceecab-4074-476b-849b-127778472096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.129522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-00ceecab-4074-476b-849b-127778472096 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:24.130717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-00ceecab-4074-476b-849b-127778472096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:24.205408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 503/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:24.229070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab13fcd-0614-40c5-ba82-140ee9cf10de None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:24.328815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab13fcd-0614-40c5-ba82-140ee9cf10de None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:24.360818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:24.361408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.361691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.361967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.362691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:24.364087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9593513-e9b3-4088-9eb1-4d509f56b738 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:24.423651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 507/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:24 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:24.488271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db45e-0c89-43d2-aaad-6b2cf098475e None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.488600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db45e-0c89-43d2-aaad-6b2cf098475e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.488824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db45e-0c89-43d2-aaad-6b2cf098475e None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.490426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 504/1011] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:24.495968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.496262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.496599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.514967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:24.516268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:24.591513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 508/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:24 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:24.615836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0db45e-0c89-43d2-aaad-6b2cf098475e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:24.718002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0db45e-0c89-43d2-aaad-6b2cf098475e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:24.750727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:24.751544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.751830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.752108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.752763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:24.754143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:24.765678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 08:01:24.767019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 505/1013] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:24.773092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:24.867442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594f87e-4c3a-4da0-90bd-cb7fea86874b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:24.900667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:24.901335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:24.901620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:24.901897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:24.902599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:24.902936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:24.904395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:24.914003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 509/1014] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:24.914936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:25.013868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044a53-9f89-494e-840d-ff485ec6eaf8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:25.047380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:25.048080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.048368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.048645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.049356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:25.049668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:25.051034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a0ef-8793-4741-9ed3-92e3ee482416 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:25.055956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 506/1015] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 12 08:01:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:25.061395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:25.160450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079f36-1fe1-4a8a-ba52-020cc4afcf28 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:25.193820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:25.194490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.194777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.195054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.195842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:25.197207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc28d5-d92c-486c-a75f-faf8dcbc77eb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:25.286853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 510/1016] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:01:25.461402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b52c-e1d7-482c-bf47-309a3a5f8129 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.461927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b52c-e1d7-482c-bf47-309a3a5f8129 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.461927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b52c-e1d7-482c-bf47-309a3a5f8129 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.463235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 507/1017] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:25.469596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.469887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.470178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.487995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:25.489197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:25.561729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 511/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:25.587104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b52c-e1d7-482c-bf47-309a3a5f8129 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:25.690906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b52c-e1d7-482c-bf47-309a3a5f8129 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:25.731944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:25.732745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.733028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.733301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.734807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:25.737280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048533-416d-438a-946d-2aac7b954f3f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:25.739893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 508/1019] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:25.745665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:25.839797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ed166-aeb1-4d1d-b34d-e53fbbeb4d32 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:25.873198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:25.873866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:25.874150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:25.874426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:25.875136 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:25.876618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa64625-2335-4b19-b568-86c5aef6e6bd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:25.971544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:25 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:26.745156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fde4d-6ad8-4dc0-9969-904fb1993882 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:26.745718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fde4d-6ad8-4dc0-9969-904fb1993882 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:26.745718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fde4d-6ad8-4dc0-9969-904fb1993882 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:26.747242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 509/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:26.752334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:26.752728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:26.752912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:26.769515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:26.770682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:26.837087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:26.860995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fde4d-6ad8-4dc0-9969-904fb1993882 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:26.957457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fde4d-6ad8-4dc0-9969-904fb1993882 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:26.990650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:26.991444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:26.991757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:26.992036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:26.992694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:26.994063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:27.004992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 08:01:27.006265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 510/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 12 08:01:26 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:27.011938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:27.109927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04fea0-ff22-4657-bfea-01c719be5e7e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:27.144781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:27.145453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.145735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.146011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.146718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] RBAC: Adding query filter params (name=image) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:27.147028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:27.148421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:27.158145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 514/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:27.159630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:27.263347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde18f26-786d-4d95-8f1f-da4439a5cec7 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:27.294458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:27.295119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.295400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.295696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.296395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] RBAC: Adding query filter params (type=image) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:27.296700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:27.298224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:27.307644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 511/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:27.309393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:27.412509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee0728-f10c-411c-800d-b37ef1ebf576 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:27.444961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:27.445618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.445904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.446179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.446962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] RBAC: Adding query filter params (interface=public, service_id=043b4fd7afb54471ab49eecdbc98e9f7, region_id=RegionOne) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:27.447274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:27.448683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa313d-42db-429b-bd79-7dc79c07e783 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:27.458588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 515/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:01:27 2022] GET /identity/v3/endpoints?service_id=043b4fd7afb54471ab49eecdbc98e9f7&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:27.460084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:27.554617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c737-3854-4d52-85bf-f725b8225a44 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:27.586550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:27.587218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.587516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.587796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.588469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:27.589832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa5283-e5b2-4c98-b0c9-d97ad5484ce3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:27.596336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 512/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:01:27 2022] GET /identity/v3/services => generated 1957 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:01:27.724177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f832-8f2b-49f0-b77d-4d3db0b4755c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.724833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f832-8f2b-49f0-b77d-4d3db0b4755c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.725421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f832-8f2b-49f0-b77d-4d3db0b4755c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.728403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 516/1028] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:27.734799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.735096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.735364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.753223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:27.754441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:27.821765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 513/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:27.846671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969f832-8f2b-49f0-b77d-4d3db0b4755c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:27.946331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969f832-8f2b-49f0-b77d-4d3db0b4755c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:27.981379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:27.982203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:27.982480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:27.982750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:27.992620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:28.000627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:28.006662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 517/1030] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:28.007893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.100900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad4f6-3b42-427f-bd6b-c5818d1467d6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.132857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.133522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.133802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.134074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.134823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:28.135133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.136527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161d98-d9d5-4cd9-ae1c-217587d5eeee None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.149764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 514/1031] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:28.150941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.252825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd5a7-49aa-44d5-812e-282517acdd88 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.284447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.285240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.285522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.285798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.296564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.298036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.301805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fba4-5b6f-495e-a974-c44d614735cc None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.302091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fba4-5b6f-495e-a974-c44d614735cc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.302372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fba4-5b6f-495e-a974-c44d614735cc None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.303893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 515/1032] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:28.308457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.308744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.309635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.314936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:28.320847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 518/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:28.321607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.325841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:28.327001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:28.392770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 516/1034] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:28.417983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c6ac-f607-41f0-abcb-704bac6ed428 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.418933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.454825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.455580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.455872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.456146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.456865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:28.457173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.458538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.469946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 519/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:28.475526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.515394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1bda6-27fe-4516-ae91-c4f322c1433d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.548336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.549153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.549421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.549702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.550888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.552376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.554012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 517/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:28.560038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.571813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba963b-95b6-4bc9-aa22-4fcd900f2087 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.604324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.605108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.605390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.605689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.613182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.614602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.628064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:01:28.629414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 520/1037] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:28.634886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.655686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ec74-5923-4f8d-b7a0-902aa67ed7db None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.688665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.689323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.689606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.689886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.690582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.692048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.740648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbced4-efec-49f0-8937-1e274195423e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.771527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 518/1038] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:01:28 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:28.778757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.779461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.779775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.780055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:28.780914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:28.781229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:28.782733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:28.803166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 521/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:28.809542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:28.916757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a395eb-cc09-4361-97df-4a2c2a57a05f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:28.951991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:28.952650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:28.952945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:28.953218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.020903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.022484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.116476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 519/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:29.122411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:29.221015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21f03-e671-4d77-aa98-9d02236cc127 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:29.255434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:29.256266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.256550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.256826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.266772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.268247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.285145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:29.286491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 522/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:29.291918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:29.385803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9d9c-a39d-4792-aebf-823e57fad55b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:29.419085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:29.419776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.420062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.420337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.421057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:29.421364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.422825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.433757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 520/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:29.439260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:29.537239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c36e-2a14-49d4-a56f-03ef712a239b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:29.571055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:29.571881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.572169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.572443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.579107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.580588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.594227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:29.595610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 523/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:29.601241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:29.696690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff895b-097b-4ad2-af15-37b80de4ded4 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:29.728633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:29.729291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.729568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.729837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.730659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:29.730966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.732409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0357-e222-4c97-b81f-1d7bab60af07 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.744883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 521/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:29.750645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:29.846133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8054a-29e3-44be-952f-95902c5c48ce None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:29.877691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:29.878351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.878632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.878907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.879757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] RBAC: Adding query filter params (role.id=86554916c99748188123b811fbc87e69, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:29.880069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:29.881502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a35f68-4041-479f-b9c8-c24579dad124 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:29.887673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 524/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:29 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=86554916c99748188123b811fbc87e69 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:29.895667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f7b1-1fc8-4c8a-8c91-5731831962ea None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.895667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f7b1-1fc8-4c8a-8c91-5731831962ea None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.895667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f7b1-1fc8-4c8a-8c91-5731831962ea None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.895667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 522/1046] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:29.901846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855469-6eb2-43db-979c-37823c86b102 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:29.902144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855469-6eb2-43db-979c-37823c86b102 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:29.902407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855469-6eb2-43db-979c-37823c86b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:29.920485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-db855469-6eb2-43db-979c-37823c86b102 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:29.921705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-db855469-6eb2-43db-979c-37823c86b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:29.993485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 525/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:30.018229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f7b1-1fc8-4c8a-8c91-5731831962ea None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:30.122572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f7b1-1fc8-4c8a-8c91-5731831962ea None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:30.154933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:30.155749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:30.156033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:30.156318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] PATH_INFO: `/v3/services/image` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:30.156952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:30.158307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:30.168890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 08:01:30.170220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 523/1048] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 12 08:01:30 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:30.176010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855469-6eb2-43db-979c-37823c86b102 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:30.270521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855469-6eb2-43db-979c-37823c86b102 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:30.302305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:30.302974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:30.303257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:30.303558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:30.304255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] RBAC: Adding query filter params (name=image) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:30.304561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:30.305925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:30.311070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 526/1049] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:30.316969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:30.415308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545f8f-2904-495d-8cde-1f6796126901 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:30.572745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:30.573336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:30.573618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:30.573890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:30.574632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] RBAC: Adding query filter params (type=image) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:30.574940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:30.576461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d996-d2a6-4882-ad61-5983e595fc3d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:30.581342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 524/1050] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:30.587141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:30.682843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f85b6-5478-4112-af44-f1f063988533 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:30.716687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:30.717350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:30.717638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:30.717912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:30.718654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:30.720058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498e195-95da-4409-9a6f-a1b55ae42720 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:30.831583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 527/1051] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:01:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:31.131267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56d9e-f00d-4400-a1bd-09dd658aa906 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.131791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56d9e-f00d-4400-a1bd-09dd658aa906 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.131791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56d9e-f00d-4400-a1bd-09dd658aa906 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.133146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 525/1052] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:31.138750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.139041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.139318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.155841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:31.156992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:31.228108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 528/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:31.252630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f56d9e-f00d-4400-a1bd-09dd658aa906 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:31.350147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f56d9e-f00d-4400-a1bd-09dd658aa906 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:31.382057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:31.382785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.383055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.383331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.393791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:31.401131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:01:31.407529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 526/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:31.409075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:31.502078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6fdcf-c83c-4c82-9d49-7b109cf29e44 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:31.535769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:31.536442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.536722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.536995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.537736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:31.538040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:31.539401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:31.552829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 529/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:31.553965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:31.647529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7507-56b3-45e9-8a65-1bec996fecf9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:31.682841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:31.683771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.684057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.684334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] PATH_INFO: `/v3/users/d7883e8912be4b4792a4fb3878177310` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.697380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] RBAC: Authorizing `identity:get_user(user_id=d7883e8912be4b4792a4fb3878177310)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:31.698872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:31.706718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 527/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:31 2022] GET /identity/v3/users/d7883e8912be4b4792a4fb3878177310 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:31.706873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:31.802712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309646-947b-4bc9-b825-0e6ef8b982f0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:31.833939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:31.834593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:31.834876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:31.835151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:31.903848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:31.905221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.003526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 530/1057] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 08:01:32.005514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.099526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff703a-bef0-410b-813e-b38cc42cdbdc None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.130931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.131805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.132331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.132331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.133503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:32.134919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f39e9f-002f-44ee-8278-3318d471fddc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.141833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 528/1058] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:32.143108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.217963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aea07-5be2-4cda-bb7f-0df18d41e5d6 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.218288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aea07-5be2-4cda-bb7f-0df18d41e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.218518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aea07-5be2-4cda-bb7f-0df18d41e5d6 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.219939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 529/1059] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:01:32.224820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.225103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.225378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.241925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:32.242551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85d3a8-749b-4a87-8512-26d29440a49f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.243095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:32.275323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.276012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.276294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.276575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.277925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=cb6e6529419444b9b75fffe202c7ba98, user.id=d7883e8912be4b4792a4fb3878177310) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:32.278249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:32.279691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.285165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 531/1060] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/role_assignments?user.id=d7883e8912be4b4792a4fb3878177310&scope.project.id=cb6e6529419444b9b75fffe202c7ba98&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:32.319116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 530/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:32.343070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.449843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60403-ed85-4bf6-af40-72dac7a93c98 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.484581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.485409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.485693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.485969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.496084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:32.503684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:32.505072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 532/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:32.512216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.606762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c004cf-dc54-45ba-9f80-ba8cd8f99d95 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.638557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.639265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.639570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.639846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.640585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:32.640888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:32.642248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.655544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 531/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:32.656980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.751417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670aa80-4aed-40ec-a21f-0cb05e9e1e3b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.784108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.784926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.785207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.785480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.797295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:32.798776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.816190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:32.817576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 533/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:32.822995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:32.919048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5aa9-d460-4056-808e-9a4343d054d5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:32.950780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:32.951438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:32.951748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:32.952021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:32.952732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:32.953038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:32.954396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:32.966498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 532/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:32.971899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.066704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef13f9-cf6a-4ecd-b4c9-d122043c60c7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.099051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.099866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.100148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.100421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.107841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.109269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.122846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c383c0e8-b508-48d6-ad31-c820be2cd4dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:01:33.124221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 534/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:01:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:33.129868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.160797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c423d-5f51-41fa-9431-46300467eb63 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.161346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c423d-5f51-41fa-9431-46300467eb63 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.161623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c423d-5f51-41fa-9431-46300467eb63 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.163140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 535/1067] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:33.168040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.168328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.168607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.188543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:33.189720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:33.227911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589bb5-022e-47e6-ab88-74ca7bfd0dac None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.258665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 536/1068] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:33.265456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.266127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.266405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.266679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.267539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:33.267849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.269267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.277157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.290582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 533/1069] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:33.291500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.372349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8d4f7-4bf6-48ce-b3e3-c8f6ee7fcd21 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.387920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e13c-4e22-4a18-8ab2-3431b6b15fa8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.408450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.409108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.409389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.409662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.428416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.429550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.429976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.430410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.445708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.447159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.464369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:33.465723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 534/1070] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:33.471305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.477636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.479097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.568309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6f5d2-d1f2-47b2-84c9-eb07d6cd3586 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.572574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 537/1071] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 08:01:33.580110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.600951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.601609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.601891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.602168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.602884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:33.603189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.604596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.618481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 535/1072] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:33.624012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.676876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255072-afb3-4a24-80b6-d8a760ba53e2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.710693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.711503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.711791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.712060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.719784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761acb2-f79a-47df-8e2e-6f449e98fc8c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.722245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.723720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.741080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:33.749092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 538/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:33.750254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.758079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.758878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.759758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.760071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.767649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.769078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.782833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:33.784218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 536/1074] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:33.789757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:33.849967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735de9b-8454-45b4-a96a-6224a92584e0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.882980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.883592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.883878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.884158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.884869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:33.885175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.886532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.890656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed75dbd-6a45-44cc-99dd-74aaa6496a65 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:33.907508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 539/1075] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:33.934981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:33.935677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:33.935959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:33.936230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:33.937020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:33.937325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:33.938774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7944e19-39c8-43ca-a01a-2bd8df231210 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:33.952243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 537/1076] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:33.958432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:34.063951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3277e-20aa-4121-a363-6a7f0aeed1c0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:34.098522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:34.099424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:34.099727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:34.100064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/86554916c99748188123b811fbc87e69` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:34.102254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=2c961d005e574c10a93f9a876ac7ce4d, role_id=86554916c99748188123b811fbc87e69)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:34.103724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab041b9-2cc5-4d84-8065-a570cf3d97fd None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:34.190720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 540/1077] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:01:33 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/2c961d005e574c10a93f9a876ac7ce4d/roles/86554916c99748188123b811fbc87e69 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:01:34.609844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acbb3-6195-43ed-a3ef-ec5f36475d67 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:34.610356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acbb3-6195-43ed-a3ef-ec5f36475d67 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:34.610356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acbb3-6195-43ed-a3ef-ec5f36475d67 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:34.611683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 538/1078] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:34.616952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:34.617357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:34.617508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:34.633636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:34.634796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:34.696656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 541/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:34.719161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614acbb3-6195-43ed-a3ef-ec5f36475d67 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:34.820273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614acbb3-6195-43ed-a3ef-ec5f36475d67 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:34.852257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:34.853040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:34.853322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:34.853595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:34.863243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:34.870155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:01:34.871940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 539/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:34.879210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:34.973512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640889-da04-4754-a5b8-a7590c2e3cf7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:35.006125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:35.006784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:35.007065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:35.007340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:35.008122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:35.008429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:35.009782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:35.017561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 542/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:35.023316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:35.116377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9739-983f-4a71-91e4-b606d8e8bc82 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:35.147073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:35.147964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:35.148245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:35.148517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] PATH_INFO: `/v3/users/d7883e8912be4b4792a4fb3878177310` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:35.149935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=d7883e8912be4b4792a4fb3878177310)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:35.151342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:35.152994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 540/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:35 2022] GET /identity/v3/users/d7883e8912be4b4792a4fb3878177310 => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:35.158575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:35.253303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c691c6-d2f2-4972-841c-12b9314823a6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:35.284029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:35.284872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:35.285150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:35.285420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:35.286586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:35.288057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df96637-8be1-4890-9375-3d5d88d12585 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:35.289962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 543/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:35 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:35.296420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:35.390506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa589b-7849-4950-b57f-89bafafe9bd7 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:35.422665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:35.423564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:35.423844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:35.424115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98/users/d7883e8912be4b4792a4fb3878177310/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:35.426026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] RBAC: Authorizing `identity:create_grant(project_id=cb6e6529419444b9b75fffe202c7ba98, user_id=d7883e8912be4b4792a4fb3878177310, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:35.427433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540b9ae-5ce9-43a0-9e01-bdee3b97c4ad None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:35.531761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 541/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:01:35 2022] PUT /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98/users/d7883e8912be4b4792a4fb3878177310/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:01:36.487229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9070-15bc-441c-985c-f19932080ee5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:36.487784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9070-15bc-441c-985c-f19932080ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:36.487784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9070-15bc-441c-985c-f19932080ee5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:36.489094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 544/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:36.494311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:36.494725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:36.494878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:36.510993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:36.512718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:36.575902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 542/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:36.600432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f9070-15bc-441c-985c-f19932080ee5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:36.698304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f9070-15bc-441c-985c-f19932080ee5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:36.730655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:36.731455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:36.731755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:36.732026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:36.741767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:36.749230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 08:01:36.750570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 545/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 12 08:01:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:36.756475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:36.847636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce82f-062d-4a8e-9efe-34650073d2e1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:36.878803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:36.879453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:36.879764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:36.880040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:36.880778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:36.881143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:36.882525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:36.890477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 543/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:01:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:36.895985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:36.990599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493065d-07f3-4342-bfa6-dcb0cca79b16 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.022326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.023042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.023325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.023637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.033923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.035348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.051114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:37.052312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 546/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:37.058127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.151150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef2c-e5b2-4bd1-b53e-6d46349a8eb1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.182226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.182889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.183171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.184010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.184737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:37.185041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.186408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.197985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 544/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:37.204264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.297328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442746a-247d-4603-8085-5fcbf029b26c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.328363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.329149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.329422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.329687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.337544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.338972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.351774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 08:01:37.353123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 547/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:37.359313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.458060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f600a3d-62af-4c46-a764-688bda74bdde None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.490806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.491465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.491775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.492047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.492879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:37.493189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.494636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a05cc8-6e09-4767-a422-428d1114b039 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.511328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 545/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:37.517969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.610905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7028b8-0c47-4dbb-815e-a477d66bef44 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.642848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.643519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.643807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.644079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.707803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.710527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.787921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ed2d9-134e-4a31-8651-791e5e37711f None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.788203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ed2d9-134e-4a31-8651-791e5e37711f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.788473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ed2d9-134e-4a31-8651-791e5e37711f None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.789834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 546/1093] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:37.794665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.794944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.795226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.807155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 548/1094] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:37.811592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:37.813051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:37.813160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.877355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 547/1095] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:37.903539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.907143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120aae2-427e-4ddb-a97a-132d8d1e155d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:37.939191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:37.940014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:37.940300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:37.940574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:37.950648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:37.952116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:37.968282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:01:37.969444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 549/1096] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:37.975172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:37.995003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f7ed-fe89-4dc7-9fd3-e70d75a2b0c0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.026873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.027705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.027988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.028259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.037719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:38.045251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:01:38.046415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 548/1097] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:38.052289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.068043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ddd3-1506-46bb-bffb-3865cbe928c0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.099181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.099866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.100148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.100422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.101126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:38.101434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.102782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.113923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 550/1098] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:38.119594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.144572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d87b7-df7e-4954-8f0a-d98454e0b914 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.175850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.179155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.179155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.179155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.179155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:38.179155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.179732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.188110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 549/1099] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:38.193785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.215310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587981e-ff88-4b2e-a3a6-729bcf37c281 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.247138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.247954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.248232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.248507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.254771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.256229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.269242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:01:38.270380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 551/1100] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:01:38.276237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.286737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869aad-cef6-4432-8536-5e950ccd4e19 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.318855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.319752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.320037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.320312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] PATH_INFO: `/v3/users/d7883e8912be4b4792a4fb3878177310` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.321507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] RBAC: Authorizing `identity:get_user(user_id=d7883e8912be4b4792a4fb3878177310)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.322935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.324620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 550/1101] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/users/d7883e8912be4b4792a4fb3878177310 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:38.330131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.367732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4222f-4d44-4e46-838f-1dce4a674d78 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.402696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.402696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.402696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.402696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.403075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:38.403075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.403929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.414908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 552/1102] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:38.421407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.423835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea88ebd-df49-48be-925a-a1864f714a4f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.455004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.455678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.455963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.456237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.512562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4b3a-8725-43e6-a62f-e82b648462d0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.519241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.520714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.544404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.545041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.545317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.545585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.546427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] RBAC: Adding query filter params (role.id=86554916c99748188123b811fbc87e69, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=2c961d005e574c10a93f9a876ac7ce4d) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:38.546756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.549183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.556562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 553/1103] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/role_assignments?user.id=2c961d005e574c10a93f9a876ac7ce4d&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=86554916c99748188123b811fbc87e69 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:38.618982 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 551/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 08:01:38.625249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.726343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e2e2-79c9-49f5-9c0b-040c8a8e6c21 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.759229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.760112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.760393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.760668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.762380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.763830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616990-db26-44f5-9319-6daebae608c9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.765508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 554/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:38.771696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:38.870157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6293f-b4f9-43af-9bb2-c10dd1dd1096 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:38.903699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:38.904351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:38.904634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:38.904911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:38.905742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=cb6e6529419444b9b75fffe202c7ba98, user.id=d7883e8912be4b4792a4fb3878177310) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:38.906053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:38.907501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def04a4-f0c3-4eb3-bc79-18035fcdf681 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:38.913450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 552/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:38 2022] GET /identity/v3/role_assignments?user.id=d7883e8912be4b4792a4fb3878177310&scope.project.id=cb6e6529419444b9b75fffe202c7ba98&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:41.218816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce42f-ced0-4c6e-b937-5f69768785df None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:41.219253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce42f-ced0-4c6e-b937-5f69768785df None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:41.219350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce42f-ced0-4c6e-b937-5f69768785df None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:41.220725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 555/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:41.225695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:41.226136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:41.226237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:41.242408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:41.243616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:41.306133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 553/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:41.331695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce42f-ced0-4c6e-b937-5f69768785df None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:41.428889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce42f-ced0-4c6e-b937-5f69768785df None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:41.461809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:41.462522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:41.462798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:41.463064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:41.464233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:41.465707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ff649-d775-4072-8300-b9704c7dfc84 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:41.467273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 556/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:41.473132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:41.566371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a5b3-6d64-41c9-bc32-ddf26a9415a6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:41.599957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:41.600618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:41.600901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:41.601177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:41.601885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:41.603303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528186a-1f39-43e9-bbbd-3321d44022c2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:41.685003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 554/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:01:41 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:43.987540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98d134-87cc-4e85-81d1-1bce8ca109c5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:43.988068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98d134-87cc-4e85-81d1-1bce8ca109c5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:43.988068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98d134-87cc-4e85-81d1-1bce8ca109c5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:43.989419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 557/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:43.994610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:43.995006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:43.995167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:44.011781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:44.012930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:44.073895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 555/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:44.099443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98d134-87cc-4e85-81d1-1bce8ca109c5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:44.198125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98d134-87cc-4e85-81d1-1bce8ca109c5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:44.230941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:44.231815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:44.232098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:44.232370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] PATH_INFO: `/v3/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:44.233829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] RBAC: Authorizing `identity:get_role(role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:44.235238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:44.236602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 558/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:44 2022] GET /identity/v3/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:44.242526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:44.335436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71009dc2-ea2b-4cef-9ada-ce02452d6db7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:44.368461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:44.369442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:44.369726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:44.370003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] PATH_INFO: `/v3/users/731035dd27c7423380ccf8f51743c238` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:44.382557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] RBAC: Authorizing `identity:get_user(user_id=731035dd27c7423380ccf8f51743c238)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:44.384026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:44.385677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 556/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:44 2022] GET /identity/v3/users/731035dd27c7423380ccf8f51743c238 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:44.391416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:44.605830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbde79c-20ef-422b-bfff-a12aa99d314c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:44.636423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:44.637052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:44.637331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:44.637602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:44.699717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:44.701124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:44.790859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 559/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:44.796797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:44.888320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e2e2-8775-4f76-a231-814e78303f67 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:44.919760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:44.920594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:44.920875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:44.921148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:44.922296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:44.923725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35432-cf11-440f-808c-a84d1aaac13d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:44.925369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 557/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:44 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:44.931225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:45.023739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914925-9ddd-4c32-8abb-6f39a546f2df None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:45.054954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:45.055610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:45.055889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:45.056160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:45.056960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=cb6e6529419444b9b75fffe202c7ba98, user.id=731035dd27c7423380ccf8f51743c238) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:45.057267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:45.058699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a88a0-2132-4efe-90d6-7728e243842b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:45.063986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 560/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:44 2022] GET /identity/v3/role_assignments?user.id=731035dd27c7423380ccf8f51743c238&scope.project.id=cb6e6529419444b9b75fffe202c7ba98&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:47.286050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce4fd-abea-46a8-b98c-32b53ef4253b None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.286539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce4fd-abea-46a8-b98c-32b53ef4253b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.286626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce4fd-abea-46a8-b98c-32b53ef4253b None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.287994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 558/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:47.293310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.293736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.293914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.310439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:47.311641 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:47.374305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 561/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:01:47.397148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce4fd-abea-46a8-b98c-32b53ef4253b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:47.490151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce4fd-abea-46a8-b98c-32b53ef4253b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:47.521541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:47.522364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.522640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.522910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] PATH_INFO: `/v3/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.524626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] RBAC: Authorizing `identity:get_role(role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:47.525976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:47.527327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 559/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:47 2022] GET /identity/v3/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:47.533054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:47.622846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf9e57-da95-4c1b-b82d-6e6e435c4d12 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:47.654244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:47.655086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.655363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.655665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] PATH_INFO: `/v3/users/731035dd27c7423380ccf8f51743c238` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.656825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] RBAC: Authorizing `identity:get_user(user_id=731035dd27c7423380ccf8f51743c238)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:47.658230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:47.659813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 562/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:47 2022] GET /identity/v3/users/731035dd27c7423380ccf8f51743c238 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:47.665223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:47.757386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbdf91-e835-4d6b-9d74-56d0b615b94f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:47.788712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:47.789545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.789826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.790098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.791250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:47.793244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5848ec-5533-48a7-bd5c-3eb1d9047122 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:47.794898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 560/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:47 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:47.802143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:47.893637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca0c8-a741-4d91-abf0-c2444b1897e0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:47.925259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:47.926140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:47.926414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:47.926683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98/users/731035dd27c7423380ccf8f51743c238/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:47.928841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] RBAC: Authorizing `identity:create_grant(project_id=cb6e6529419444b9b75fffe202c7ba98, user_id=731035dd27c7423380ccf8f51743c238, role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:47.930239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892b1b1-d63e-479a-8d3d-9f4da383dc0b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:47.993365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 563/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:01:47 2022] PUT /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98/users/731035dd27c7423380ccf8f51743c238/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:01:50.308980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca23e5-fba5-46a8-bddf-bf2096da4207 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:50.309525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca23e5-fba5-46a8-bddf-bf2096da4207 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:50.309525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca23e5-fba5-46a8-bddf-bf2096da4207 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:50.310884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 561/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:50.315946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:50.316331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:50.316515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:50.332371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:50.333527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:50.396039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 564/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:50.421500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca23e5-fba5-46a8-bddf-bf2096da4207 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:50.515236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca23e5-fba5-46a8-bddf-bf2096da4207 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:50.547333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:50.548200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:50.548479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:50.548748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] PATH_INFO: `/v3/roles/b270c032ed9c42d5a4ab292e181cf326` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:50.550183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] RBAC: Authorizing `identity:get_role(role_id=b270c032ed9c42d5a4ab292e181cf326)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:50.551559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:50.552875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 562/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:50 2022] GET /identity/v3/roles/b270c032ed9c42d5a4ab292e181cf326 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:50.558750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:50.648815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1c34-ca72-4c3f-a535-fcc512a40b93 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:50.680493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:50.681333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:50.681610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:50.681882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] PATH_INFO: `/v3/users/731035dd27c7423380ccf8f51743c238` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:50.683085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] RBAC: Authorizing `identity:get_user(user_id=731035dd27c7423380ccf8f51743c238)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:50.684517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:50.686062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 565/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:50 2022] GET /identity/v3/users/731035dd27c7423380ccf8f51743c238 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:01:50.691485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:50.784651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b5a71-aebc-4a36-8fdd-a9e9f8645c91 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:50.815405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:50.816057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:50.816341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:50.816637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:50.878908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:50.880353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:50.971218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 563/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:50.976882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:51.069976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e7df-c63b-4f3e-b034-0c3bdbfc86cb None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:51.100807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:51.101631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:51.101906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:51.102174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] PATH_INFO: `/v3/projects/cb6e6529419444b9b75fffe202c7ba98` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:51.103312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] RBAC: Authorizing `identity:get_project(project_id=cb6e6529419444b9b75fffe202c7ba98)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:51.105413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1740546-ca10-49e5-a146-a0d8fdff99b6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:51.107014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 566/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:50 2022] GET /identity/v3/projects/cb6e6529419444b9b75fffe202c7ba98 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:51.112964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:51.211385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2168c0-f2d6-493b-a080-c80049679a1b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:51.244019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:51.244662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:51.244945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:51.245243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:51.246110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] RBAC: Adding query filter params (role.id=b270c032ed9c42d5a4ab292e181cf326, scope.project.id=cb6e6529419444b9b75fffe202c7ba98, user.id=731035dd27c7423380ccf8f51743c238) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:51.246420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:51.247877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859afa-a14e-4f72-986f-5aa0b28205fe None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:51.253444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 564/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:01:51 2022] GET /identity/v3/role_assignments?user.id=731035dd27c7423380ccf8f51743c238&scope.project.id=cb6e6529419444b9b75fffe202c7ba98&role.id=b270c032ed9c42d5a4ab292e181cf326 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:53.555907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc774-f773-4874-a8f2-cfc4429ddc33 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:53.556420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc774-f773-4874-a8f2-cfc4429ddc33 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:53.556420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc774-f773-4874-a8f2-cfc4429ddc33 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:53.558233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 567/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:53.563319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:53.563749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:53.563928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:53.580664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:53.581837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:53.643377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 565/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:53.667333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fc774-f773-4874-a8f2-cfc4429ddc33 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:53.760584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fc774-f773-4874-a8f2-cfc4429ddc33 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:53.792453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:53.793227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:53.793507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:53.793776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:53.794931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:53.796370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784a85-61e9-45ee-a04d-14d6fc72c2b4 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:53.797944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 568/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:53.803744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:53.900318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3edcfd-84cb-4ea8-a898-bb58a47a4311 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:53.932031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:53.932680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:53.932966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:53.933242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:53.933943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:53.935365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0eff3-94ce-4dbd-a024-b11e82407241 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:54.018010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 566/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:01:53 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:56.297598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643201a-52cc-42ba-8e40-2e2454ee650a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:56.298120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643201a-52cc-42ba-8e40-2e2454ee650a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:56.298120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643201a-52cc-42ba-8e40-2e2454ee650a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:56.299487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 569/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:56.304639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:56.305030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:56.305204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:56.321331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:56.322509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:56.384535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 567/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:56.410531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643201a-52cc-42ba-8e40-2e2454ee650a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:56.504067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643201a-52cc-42ba-8e40-2e2454ee650a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:56.539119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:56.539937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:56.540212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:56.540485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:56.541655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:56.543670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6c35-bccb-4f77-ae3d-676ee31d0b32 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:56.545268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 570/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:56.550997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:56.642242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1decf9e-b710-4c96-8c5c-2e31fe06f08c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:56.675037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:56.675720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:56.676008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:56.676283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:56.676989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:56.678408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df93856-2581-44a2-9f19-f17c8d965e4e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:56.764906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 568/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:01:56 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:01:59.052780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f62a1-21b1-472c-a8d6-2488241f707b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.053311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f62a1-21b1-472c-a8d6-2488241f707b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.053311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f62a1-21b1-472c-a8d6-2488241f707b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.054653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 571/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:01:59.060458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.060864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.061015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.077003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:01:59.078154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:01:59.139216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 569/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:01:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:01:59.162939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f62a1-21b1-472c-a8d6-2488241f707b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:59.262342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f62a1-21b1-472c-a8d6-2488241f707b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:59.294256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56475164-d593-4888-a329-c010131ac087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:59.295039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56475164-d593-4888-a329-c010131ac087 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.295324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56475164-d593-4888-a329-c010131ac087 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.295630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56475164-d593-4888-a329-c010131ac087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.305232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56475164-d593-4888-a329-c010131ac087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:01:59.312835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-56475164-d593-4888-a329-c010131ac087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:01:59.313996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 572/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:01:59.320274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:59.412186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5c6b7-08ea-49d5-84f8-f7366b9c9af8 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:59.443694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:59.444341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.444621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.444893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.445625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:01:59.445929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:59.447273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:59.454836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 570/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:59.460554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56475164-d593-4888-a329-c010131ac087 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:59.559631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56475164-d593-4888-a329-c010131ac087 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:59.590678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:59.591555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.591834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.592101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] PATH_INFO: `/v3/users/7875a6deddef4d17b3758b17fae563f4` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.604773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] RBAC: Authorizing `identity:get_user(user_id=7875a6deddef4d17b3758b17fae563f4)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:59.606186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:59.607810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 573/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:01:59 2022] GET /identity/v3/users/7875a6deddef4d17b3758b17fae563f4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:01:59.613562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:59.705622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2abcc2-a6ea-4977-aae1-b841d64989b9 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:01:59.736232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:01:59.736859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:01:59.737140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:01:59.737467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:01:59.799861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:01:59.801287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:01:59.892016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 571/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:01:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:59.897857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:01:59.989436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703cef0-21cb-4d8d-b59e-a3612546255d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:00.020313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:00.021140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:00.021416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:00.021686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] PATH_INFO: `/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:00.022825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2465d5a6e4f0982a4a363e1ee51a9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:00.024522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ca902-d178-423c-b946-fb3dd3f6d7ee None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:00.026722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 574/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:01:59 2022] GET /identity/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:00.032470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:00.122000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716a43-6af9-4437-ac94-8e362d9f9720 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:00.153338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:00.153942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:00.154220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:00.154494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:00.155309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=d2e2465d5a6e4f0982a4a363e1ee51a9, user.id=7875a6deddef4d17b3758b17fae563f4) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:00.155653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:00.157088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65e88-6ff5-41a3-b3a7-c4b5c320a541 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:00.162156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 572/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:02:00 2022] GET /identity/v3/role_assignments?user.id=7875a6deddef4d17b3758b17fae563f4&scope.project.id=d2e2465d5a6e4f0982a4a363e1ee51a9&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:02.386712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b8ec-12ad-4f82-813e-fe79aee828dd None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:02.387232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b8ec-12ad-4f82-813e-fe79aee828dd None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:02.387421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b8ec-12ad-4f82-813e-fe79aee828dd None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:02.388651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 575/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:02.393828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:02.394202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:02.394388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:02.412080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:02.413246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:02.474773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 573/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:02.496596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b8ec-12ad-4f82-813e-fe79aee828dd None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:02.590971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b8ec-12ad-4f82-813e-fe79aee828dd None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:02.622791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:02.623588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:02.623875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:02.624149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:02.633709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:02:02.640670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:02:02.641811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 576/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:02.648836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:02.740873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1526d-fd5b-4834-bdd5-6cfc703dc9f5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:02.771974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:02.772619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:02.772902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:02.773177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:02.774162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:02.774479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:02.776446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:02.783970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 574/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:02.789452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:02.881829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a978e-1f79-42b9-86c0-7e38799b30c4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:02.913904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:02.914749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:02.915031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:02.915307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] PATH_INFO: `/v3/users/7875a6deddef4d17b3758b17fae563f4` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:02.916535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] RBAC: Authorizing `identity:get_user(user_id=7875a6deddef4d17b3758b17fae563f4)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:02.917953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:02.919540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 577/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:02:02 2022] GET /identity/v3/users/7875a6deddef4d17b3758b17fae563f4 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:02.924842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:03.016716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf730d9-7081-48b3-a178-b32f3314e44e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:03.047788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:03.048621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:03.048900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:03.049172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] PATH_INFO: `/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:03.050337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2465d5a6e4f0982a4a363e1ee51a9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:03.051770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8df3e-bd7a-4be7-8d34-723092cd95b8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:03.053404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 575/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:02:02 2022] GET /identity/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:03.058936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:03.152030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a24e-c627-4537-b4ca-a37c24505b9e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:03.183224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:03.184146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:03.184423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:03.184702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] PATH_INFO: `/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9/users/7875a6deddef4d17b3758b17fae563f4/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:03.186639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2465d5a6e4f0982a4a363e1ee51a9, user_id=7875a6deddef4d17b3758b17fae563f4, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:03.188086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8524a9c-4109-43f8-95b3-20d81bbb0398 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:03.273755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 578/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:02:03 2022] PUT /identity/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9/users/7875a6deddef4d17b3758b17fae563f4/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:02:05.514534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a4cb-e190-4b97-aa87-4c151e69e4f2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:05.515028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a4cb-e190-4b97-aa87-4c151e69e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:05.515028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a4cb-e190-4b97-aa87-4c151e69e4f2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:05.516397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 576/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:05.521606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:05.521973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:05.522156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:05.538758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:05.539956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:05.600646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 579/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:05.624977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a4cb-e190-4b97-aa87-4c151e69e4f2 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:05.720344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a4cb-e190-4b97-aa87-4c151e69e4f2 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:05.750996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:05.751794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:05.752075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:05.752349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:05.762379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:02:05.769467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:02:05.770559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 577/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:05.777309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:05.868166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dbc4b-6773-4fec-bf3e-3bb2fdaf941e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:05.901187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:05.901859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:05.902143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:05.902414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:05.903145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:05.903453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:05.904843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:05.912421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 580/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:05.918227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:06.009888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e375-eaac-4899-9595-dbbab622d5d1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:06.041701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:06.042494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:06.042775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:06.043048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] PATH_INFO: `/v3/users/7875a6deddef4d17b3758b17fae563f4` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:06.044247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] RBAC: Authorizing `identity:get_user(user_id=7875a6deddef4d17b3758b17fae563f4)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:06.045661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:06.047229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 578/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:02:05 2022] GET /identity/v3/users/7875a6deddef4d17b3758b17fae563f4 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:06.052810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:06.145548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbb8a-3b2a-40d3-9fc9-f616b46e8e97 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:06.176081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:06.176713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:06.176995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:06.177266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:06.239606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:06.241033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:06.331918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 581/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:02:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:02:06.337684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:06.430686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6a64-2714-42a5-bea5-b3fee557eec5 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:06.462212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:06.463086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:06.463368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:06.463674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] PATH_INFO: `/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:06.464835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e2465d5a6e4f0982a4a363e1ee51a9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:06.466248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fd0b2-639a-4943-aec4-4e99dd7b6c08 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:06.467923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 579/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:02:06 2022] GET /identity/v3/projects/d2e2465d5a6e4f0982a4a363e1ee51a9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:06.473744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:06.566150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750eb7-6bdb-4434-9113-1c131c40df08 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:06.596938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:06.597516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:06.597795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:06.598065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:06.598873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=d2e2465d5a6e4f0982a4a363e1ee51a9, user.id=7875a6deddef4d17b3758b17fae563f4) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:06.599181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:06.600623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8961bb-3b58-4471-a28e-d4fe480d5397 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:06.606675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 582/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:02:06 2022] GET /identity/v3/role_assignments?user.id=7875a6deddef4d17b3758b17fae563f4&scope.project.id=d2e2465d5a6e4f0982a4a363e1ee51a9&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:08.863145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c31c6-5358-488d-ada5-8a2755abeef3 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:08.863770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c31c6-5358-488d-ada5-8a2755abeef3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:08.863770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c31c6-5358-488d-ada5-8a2755abeef3 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:08.864982 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 580/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:08.869959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:08.870359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:08.870513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:08.887197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:08.888421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:08.949942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 583/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:08.971798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c31c6-5358-488d-ada5-8a2755abeef3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:09.064634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c31c6-5358-488d-ada5-8a2755abeef3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:09.096299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:09.096935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:09.097218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:09.097496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:09.162129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:09.163587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:09.255098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 581/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:02:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:02:09.262905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:09.353586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ceb0e-ce02-4ffc-85ba-859a1009f0c2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:09.385597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:09.386391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:09.386677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:09.386953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:09.393427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:09.394847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:09.408889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c4b6bcef-d799-49cb-bb6b-f66030343e7d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 12 08:02:09.410039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 584/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:02:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:09.415849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:09.508258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa25225-b67d-4ece-be7e-49e64a1d24d0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:09.539849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:09.540492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:09.540775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:09.541572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:09.542332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:09.542639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:09.544021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce0c7-eab0-47c1-9073-352234627ed4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:09.550817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 582/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 12 08:02:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:11.798745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c1c5-7360-4e0a-abdd-b0dd5927e51a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:11.799290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c1c5-7360-4e0a-abdd-b0dd5927e51a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:11.799290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c1c5-7360-4e0a-abdd-b0dd5927e51a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:11.800662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 585/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:11.805711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fd5b-dca2-48b6-b1fe-6db7c050466e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:11.806143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fd5b-dca2-48b6-b1fe-6db7c050466e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:11.806248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fd5b-dca2-48b6-b1fe-6db7c050466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:11.822751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0a37fd5b-dca2-48b6-b1fe-6db7c050466e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:11.823939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0a37fd5b-dca2-48b6-b1fe-6db7c050466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:11.892607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 583/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:11.920823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c1c5-7360-4e0a-abdd-b0dd5927e51a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:12.015940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c1c5-7360-4e0a-abdd-b0dd5927e51a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:12.047527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:12.048176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:12.048459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:12.048736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:12.049507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:12.050809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6b937-a780-40a1-8f46-1ebe89be99b0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:12.129979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 586/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue Apr 12 08:02:11 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:02:14.407726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1efdc-137c-4007-a708-0099ab931f92 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:14.408261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1efdc-137c-4007-a708-0099ab931f92 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:14.408261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1efdc-137c-4007-a708-0099ab931f92 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:14.409629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 584/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:14.414575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836d34-3e25-4261-be27-678686125e5f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:14.414997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836d34-3e25-4261-be27-678686125e5f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:14.415147 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836d34-3e25-4261-be27-678686125e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:14.431776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-db836d34-3e25-4261-be27-678686125e5f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:14.432946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-db836d34-3e25-4261-be27-678686125e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:14.495724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 587/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:14.519398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1efdc-137c-4007-a708-0099ab931f92 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:14.615497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1efdc-137c-4007-a708-0099ab931f92 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:14.646458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:14.647301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:14.647605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:14.647874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] PATH_INFO: `/v3/domains/3476a27bfa844866be89f01461797abe` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:14.658218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3476a27bfa844866be89f01461797abe)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:14.659666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2235d-9667-42d1-b65a-44f65a0cca19 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:14.661256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 585/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Apr 12 08:02:14 2022] GET /identity/v3/domains/3476a27bfa844866be89f01461797abe => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:14.667728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db836d34-3e25-4261-be27-678686125e5f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:14.757318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db836d34-3e25-4261-be27-678686125e5f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:14.789255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:14.789907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:14.790179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:14.790449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:14.791160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:14.792592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea3ed-1934-4ef9-bdfa-e65c07940702 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:14.892056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 588/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:02:14 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:02:17.175861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06292-a3f7-4047-9a41-2df71d27551b None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:17.176421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06292-a3f7-4047-9a41-2df71d27551b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:17.176421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06292-a3f7-4047-9a41-2df71d27551b None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:17.177766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 586/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:17.182920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:17.183345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:17.183493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:17.200009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:17.201171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:17.264201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 589/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:17.290287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c06292-a3f7-4047-9a41-2df71d27551b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:17.385672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c06292-a3f7-4047-9a41-2df71d27551b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:17.417000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:17.417837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:17.418123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:17.418396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] PATH_INFO: `/v3/domains/3476a27bfa844866be89f01461797abe` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:17.419606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3476a27bfa844866be89f01461797abe)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:17.421015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217d1a4-8b8a-444d-947d-d27034f0c0b3 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:17.422578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 587/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Apr 12 08:02:17 2022] GET /identity/v3/domains/3476a27bfa844866be89f01461797abe => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:17.428159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:17.519151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb94f1-b754-4c8c-9b9d-dc52584dbbc2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:17.549867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:17.550510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:17.550787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:17.551055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:17.551784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:17.553181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf786f-cf3a-4b28-80b8-150d5fff367c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:17.655915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 590/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:02:17 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:02:19.944430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a02d8-1c6b-48f2-98f8-60521d67c471 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:19.944960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a02d8-1c6b-48f2-98f8-60521d67c471 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:19.944960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a02d8-1c6b-48f2-98f8-60521d67c471 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:19.946328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 588/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:19.952171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:19.952534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:19.952731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:19.968736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:19.969901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:20.031753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 591/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:20.055951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a02d8-1c6b-48f2-98f8-60521d67c471 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:20.149391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a02d8-1c6b-48f2-98f8-60521d67c471 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:20.180735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:20.182197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:20.182482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:20.182757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:20.196055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:02:20.207752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:02:20.209494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 589/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:20.215665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:20.314503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a18b8-370f-4b38-8ac7-0655847cd6a2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:20.346425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:20.348514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:20.348514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:20.348514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:20.348514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:20.348837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:20.350049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:20.358431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 592/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:20.364387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:20.456669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f87cd-3be1-492e-b7ea-ee2190380e98 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:20.488236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:20.489117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:20.489397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:20.489666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] PATH_INFO: `/v3/users/c53034fc94d647e7a40f4abb6fd64e61` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:20.501857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] RBAC: Authorizing `identity:get_user(user_id=c53034fc94d647e7a40f4abb6fd64e61)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:20.503279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:20.504930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 590/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/users/c53034fc94d647e7a40f4abb6fd64e61 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:20.510697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:20.612745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be305a-602a-4b16-880e-f4f22de91171 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:20.643719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:20.644355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:20.644637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:20.644913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:20.707939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:20.709320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:20.800427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 593/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:02:20.806318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:20.901089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9128b-95e4-440e-bcef-fff5ba8a0011 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:20.933098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:20.933939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:20.934222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:20.934495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] PATH_INFO: `/v3/projects/f824f543fd0141f68346a200fe6b9e3a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:20.935690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] RBAC: Authorizing `identity:get_project(project_id=f824f543fd0141f68346a200fe6b9e3a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:20.937129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa004c6-c9ee-4a45-8431-e9a8024f8379 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:20.938801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 591/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/projects/f824f543fd0141f68346a200fe6b9e3a => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:20.944821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:21.036907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420c095-eeac-4d51-921e-7d8adf44b8a2 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:21.067607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:21.068240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:21.068522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:21.068798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:21.069610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=f824f543fd0141f68346a200fe6b9e3a, user.id=c53034fc94d647e7a40f4abb6fd64e61) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:21.069919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:21.071332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14415bcc-2cd5-40c8-b744-4a8e89e2a07d None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:21.076943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 594/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:02:20 2022] GET /identity/v3/role_assignments?user.id=c53034fc94d647e7a40f4abb6fd64e61&scope.project.id=f824f543fd0141f68346a200fe6b9e3a&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:23.362444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e452-8b02-4bcf-b518-ea2f5eb303e1 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:23.362965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e452-8b02-4bcf-b518-ea2f5eb303e1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:23.363156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e452-8b02-4bcf-b518-ea2f5eb303e1 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:23.364442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 592/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:23.370269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:23.370669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:23.370826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:23.387445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:23.388656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:23.449549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 595/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:23.471262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1e452-8b02-4bcf-b518-ea2f5eb303e1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:23.563911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1e452-8b02-4bcf-b518-ea2f5eb303e1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:23.595426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:23.596222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:23.596501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:23.596772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:23.606224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:02:23.613113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:02:23.614238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 593/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:23.621867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:23.712531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d236-4e87-4b49-a671-3ea96ef57284 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:23.744015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:23.744658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:23.744941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:23.745210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:23.745934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:23.746233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:23.747595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:23.755009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 596/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:23.760518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:23.852239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a47b-d000-4ae7-a71d-52d3931ecf1a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:23.883744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:23.884625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:23.884899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:23.885170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] PATH_INFO: `/v3/users/c53034fc94d647e7a40f4abb6fd64e61` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:23.886318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] RBAC: Authorizing `identity:get_user(user_id=c53034fc94d647e7a40f4abb6fd64e61)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:23.887746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:23.889307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 594/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:02:23 2022] GET /identity/v3/users/c53034fc94d647e7a40f4abb6fd64e61 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:23.894779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:23.995664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa297-ae57-40d3-9558-9d04e37c28c6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:24.026806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:24.027675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:24.027958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:24.028233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] PATH_INFO: `/v3/projects/f824f543fd0141f68346a200fe6b9e3a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:24.029400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] RBAC: Authorizing `identity:get_project(project_id=f824f543fd0141f68346a200fe6b9e3a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:24.030824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f72bf-6387-4f72-b6be-64892e97a235 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:24.032513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 597/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:02:23 2022] GET /identity/v3/projects/f824f543fd0141f68346a200fe6b9e3a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:24.038593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:24.130804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346b89-a47b-4e77-b9c5-ead157c4cd82 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:24.161638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:24.162498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:24.162778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:24.163051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] PATH_INFO: `/v3/projects/f824f543fd0141f68346a200fe6b9e3a/users/c53034fc94d647e7a40f4abb6fd64e61/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:24.165010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] RBAC: Authorizing `identity:create_grant(project_id=f824f543fd0141f68346a200fe6b9e3a, user_id=c53034fc94d647e7a40f4abb6fd64e61, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:24.166980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8176d7b-c67c-4cd1-b517-31f0e9074089 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:24.284562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 595/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:02:24 2022] PUT /identity/v3/projects/f824f543fd0141f68346a200fe6b9e3a/users/c53034fc94d647e7a40f4abb6fd64e61/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:02:26.512573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b9f2-c668-472a-aadd-ff62a3cd528e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:26.513084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b9f2-c668-472a-aadd-ff62a3cd528e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:26.513084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b9f2-c668-472a-aadd-ff62a3cd528e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:26.514358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 598/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:02:26.519371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:26.519765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:26.519972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:26.536708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:02:26.537864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:02:26.600715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 596/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:02:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:02:26.625828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9b9f2-c668-472a-aadd-ff62a3cd528e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:26.719867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9b9f2-c668-472a-aadd-ff62a3cd528e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:26.750276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:26.751036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:26.751314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:26.751614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:26.761499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:02:26.768540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:02:26.769670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 599/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:02:26.776424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:26.865533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f45e9-e13b-4603-a3b9-d9002fb86048 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:26.897049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:26.897724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:26.898005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:26.898279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:26.899297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:26.900339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:26.901676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:26.914759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 597/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:26.920662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:27.025742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec182-f06f-4458-865e-3284e4da02b4 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:27.056091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:27.056934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:27.057215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:27.057486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] PATH_INFO: `/v3/users/c53034fc94d647e7a40f4abb6fd64e61` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:27.058648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] RBAC: Authorizing `identity:get_user(user_id=c53034fc94d647e7a40f4abb6fd64e61)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:27.060104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:27.061695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 600/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 12 08:02:26 2022] GET /identity/v3/users/c53034fc94d647e7a40f4abb6fd64e61 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:27.067431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:27.160221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eea7a-abc3-4e8c-80ba-1fe0dc99ef11 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:27.191762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:27.192409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:27.192697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:27.192979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:27.260017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:27.261465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:27.354013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 598/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:02:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:02:27.359827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:27.452200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10815c-d72b-48c6-b5ba-8af7263cfc78 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:27.482817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:27.483671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:27.483948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:27.484217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] PATH_INFO: `/v3/projects/f824f543fd0141f68346a200fe6b9e3a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:27.485366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] RBAC: Authorizing `identity:get_project(project_id=f824f543fd0141f68346a200fe6b9e3a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:27.486778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1972c36-d3d9-455e-9b6b-9ca16e99b0fe None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:27.488414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 601/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 12 08:02:27 2022] GET /identity/v3/projects/f824f543fd0141f68346a200fe6b9e3a => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:02:27.494856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:02:27.587461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2f27-c09f-48a3-a48b-33943f35fade None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:02:27.619647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:02:27.620232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:02:27.620515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:02:27.620799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:02:27.621624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=f824f543fd0141f68346a200fe6b9e3a, user.id=c53034fc94d647e7a40f4abb6fd64e61) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:02:27.621940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:02:27.623354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a0c30-62b5-4c34-8919-ffdccbbc645a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:02:27.628929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 599/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:02:27 2022] GET /identity/v3/role_assignments?user.id=c53034fc94d647e7a40f4abb6fd64e61&scope.project.id=f824f543fd0141f68346a200fe6b9e3a&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:44.503804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce7a-d9ac-4020-9773-07d685cb4591 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:44.504349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce7a-d9ac-4020-9773-07d685cb4591 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:44.504349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce7a-d9ac-4020-9773-07d685cb4591 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:44.505605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 602/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:03:44.510965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:44.516462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:44.516462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:44.528783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:03:44.529943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:03:44.592502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 600/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:03:44.619080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffce7a-d9ac-4020-9773-07d685cb4591 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:44.729089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffce7a-d9ac-4020-9773-07d685cb4591 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:44.768311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:44.769417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:44.769841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:44.770256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:44.785114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:44.789543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:44.804497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:44.805663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 603/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:44.811864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:44.906083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b243478-a2b3-4b76-ba7c-40c89f539aa6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:44.938087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:44.938788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:44.939063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:44.939339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:44.940098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:44.940411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:44.941776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3aaa4-2bbd-4af2-b5e4-317034ad8bcd None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:44.953095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 601/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:44.958819 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:45.055190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0da0-de5b-4525-931d-b32d0f2df071 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:45.091868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:45.092541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:45.092823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:45.093094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:45.093801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:45.095219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165d478-5ba2-442e-856f-9a5f1344c40a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:45.179544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 604/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 12 08:03:44 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:03:47.482089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d427-f6dd-4329-88cf-5e328d1a3c0a None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:47.482590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d427-f6dd-4329-88cf-5e328d1a3c0a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:47.482590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d427-f6dd-4329-88cf-5e328d1a3c0a None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:47.484041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 602/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:03:47.489103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:47.489500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:47.489661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:47.505812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:03:47.507805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:03:47.569551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 605/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:03:47.594315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4d427-f6dd-4329-88cf-5e328d1a3c0a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:47.692703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4d427-f6dd-4329-88cf-5e328d1a3c0a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:47.728135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:47.729576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:47.729860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:47.730135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:47.739753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:03:47.746815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:03:47.748019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 603/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:47.753998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:47.847389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d0c84-71c0-4ab8-9d56-09c66918d275 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:47.878415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:47.879066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:47.879348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:47.879655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:47.880386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:47.880692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:47.882045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:47.890003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 606/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:47.895729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:47.993331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e500a8-1f5a-4eef-9c52-88175b76fd79 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.026246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.027026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.027307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.027609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.037267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.038698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.054784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:48.055971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 604/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:48.061915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:48.156593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764a9d-b170-4a2f-9f61-ca6f6bf45ea0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.188465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.189134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.189420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.189700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.190640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:48.190861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.192252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.204677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 607/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:03:48.210411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:48.304757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a2df-53e8-4736-9c2f-daafaf2ff445 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.338397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.339201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.339500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.339784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.346631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.348102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.361905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:03:48.363099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 605/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:48.369831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:48.463683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e189d-cbd5-4bfd-b05d-b879a5c0615c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.496081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.496736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.497012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.497283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.498102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:48.498408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.499841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.516530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 608/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:48.522472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:48.616557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cf5c-48b7-4b47-bc5a-c91550660f86 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.648013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.648640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.649173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.649449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.712307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.713851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.806944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 606/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:03:48.812727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:48.907779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d885f-805b-4a7f-bc65-eaca4293866a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:48.939647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:48.940417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:48.940695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:48.940965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:48.951068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:48.952541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:48.968733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:48.969874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 609/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:03:48.975564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:49.075599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873cac-97be-46b8-a756-98358ac100aa None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:49.108070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:49.108749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:49.109029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:49.109302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:49.110141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:49.110449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:49.111834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:49.123025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 607/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:49.128717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:49.223840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee014a-5446-4009-9501-7cdea3504370 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:49.256197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:49.256989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:49.257270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:49.257539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:49.264609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:49.266039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:49.278981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:03:49.280156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 610/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:49.285990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:49.382927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16010-62e1-4e5d-b390-237f0067c999 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:49.414334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:49.414996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:49.415282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:49.415594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:49.416909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:49.417218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:49.418709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d59e-20fb-46c5-a149-ab42b9ac18a1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:49.430580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 608/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:49.437428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:49.532227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f52ee-261a-43ad-ad36-72c2de099dd6 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:49.565123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:49.565767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:49.566054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:49.566333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:49.567162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=3d3c0373ebde41b9aac512bf44553b4f) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:49.567498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:49.568922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5546c-9eb3-4f2d-94c1-261bdb58fdde None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:49.574119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 611/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:03:49 2022] GET /identity/v3/role_assignments?user.id=3d3c0373ebde41b9aac512bf44553b4f&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:51.817048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba73b7-6c73-4844-86e1-8002fc094de2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:51.817580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba73b7-6c73-4844-86e1-8002fc094de2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:51.817580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba73b7-6c73-4844-86e1-8002fc094de2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:51.819008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 609/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:03:51.824674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:51.825091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:51.825236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:51.842145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:03:51.843311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:03:51.906279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 612/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:03:51.928565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba73b7-6c73-4844-86e1-8002fc094de2 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.025608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba73b7-6c73-4844-86e1-8002fc094de2 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.057383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.058087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.058368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.058643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.068790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:03:52.076601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:03:52.077790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 610/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:52.085298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.178529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3d56-6d05-40b5-8979-d207e77de2cc None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.212054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.212715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.212994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.213266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.213998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] RBAC: Adding query filter params (name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:52.214302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.215687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:52.223413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 613/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:52.229215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.324618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93539f-ff22-4c6f-9ced-d4c7a51f76e2 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.356282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.356965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.357243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.357516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.368232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.370320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:52.386487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:52.387789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 611/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:52.393759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.490233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a6d45-a1a6-46f2-bc4a-7bda204ba25f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.521756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.522408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.522692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.522968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.523709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:52.524275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.525658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:52.536763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 614/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:52.543080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.637149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ad4d-9832-489f-aea2-1dec41096384 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.669265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.670054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.670338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.670611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.677770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.679194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:52.692283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:03:52.693430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 612/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:52.699397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.792772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381632-63e4-4afd-9106-373f33b9addc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.823972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.824625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.824908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.825454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.825995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:52.826300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.827740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:52.844275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 615/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:52.850022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:52.945989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b2736-ceaf-4dd9-b2d9-e31486da43b0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:52.977546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:52.978881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:52.979149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:52.979423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:52.989408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:52.990837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:53.006500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:53.007678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 613/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:53.013570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:53.108390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ce5de-1228-4a1e-99f1-d326c04d0cb0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:53.140318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:53.140966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:53.141250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:53.141556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:53.142264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:53.142574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:53.143972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:53.155414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 616/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:03:53.161159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:53.254483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45c44-71d8-4f5c-b49b-6d05e112a810 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:53.286938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:53.287750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:53.288033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:53.288307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:53.294689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:53.296154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:53.309316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:03:53.310467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 614/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:53.316398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:53.411977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade804-990c-41e8-931a-5c12fd105a48 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:53.444721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:53.445375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:53.445657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:53.445932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:53.446700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:53.447737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:53.449157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27238a-bb9f-48f4-a7bf-6b32d5c071f9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:53.460521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 617/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:53.466455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:53.561331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26df2-f3df-42a7-8b9e-9333d1344145 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:53.593690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:53.594576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:53.594854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:53.595126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/3d3c0373ebde41b9aac512bf44553b4f/roles/c7381c2b235546bab96b17d27010b5eb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:53.608625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=3d3c0373ebde41b9aac512bf44553b4f, role_id=c7381c2b235546bab96b17d27010b5eb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:53.610057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be081c2-2aa7-4b5b-abbb-b218c0769737 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:53.686654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 615/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:03:53 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/3d3c0373ebde41b9aac512bf44553b4f/roles/c7381c2b235546bab96b17d27010b5eb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:03:55.996996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537255ae-c361-4b57-8b08-b27dd8382aa6 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:55.997517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537255ae-c361-4b57-8b08-b27dd8382aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:55.997517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537255ae-c361-4b57-8b08-b27dd8382aa6 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:55.998871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 618/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:03:56.004276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.004654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.004838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.022172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:03:56.023345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:03:56.086796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 616/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:03:56.111820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537255ae-c361-4b57-8b08-b27dd8382aa6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.208635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537255ae-c361-4b57-8b08-b27dd8382aa6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:56.240600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:56.241383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.241660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.241936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.252224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:03:56.260114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 08:03:56.261340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 619/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:56.267886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.367903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874a6be-ff0e-4d83-a4ca-aa16af02dcb0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:56.404527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:56.405451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.405735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.406058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.406839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:56.407170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:56.408571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:56.417220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 617/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:56.423115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.518475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4df13-54f0-45a8-85f0-4a65176f4568 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:56.551054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:56.551935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.552214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.552485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.562606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:56.567522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:56.579725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:56.580878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 620/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:56.586692 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.681886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c902-477f-42f6-9e6e-50a727c44bb8 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:56.714015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:56.714670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.714954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.715229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.715981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:56.716293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:56.717655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:56.729522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 618/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:56.735281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.829460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641858d-ca68-4da0-808a-21c96958ece7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:56.860897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:56.861687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:56.861968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:56.862239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:56.869347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:56.870774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:56.883924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:03:56.885723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 621/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 08:03:56.891742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:56.985226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c0472-9e9f-49ad-a36e-658b57be660b None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.017119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.018062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.018062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.018342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.019099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:57.019402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.020850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.038045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 619/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:03:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:57.043826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:57.138289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269599-0c98-4fa3-9637-fd483dc1810c None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.170226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.170867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.171148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.171424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.236092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.237528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.329103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 622/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:03:57.334939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:57.429446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf6f45-8a41-4b48-baff-c78477780812 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.461748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.462556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.462841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.463117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.472670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.474097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.490412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:03:57.491607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 620/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:57.498270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:57.591926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f238-168e-4d9b-a24f-660032592a7f None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.625122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.625773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.626052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.626323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.627027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:57.627330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.628705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.639298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 623/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:57.645031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:57.738836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbbf-fad2-4983-afce-310a66fd1d5c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.771311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.772119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.772404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.772680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.779585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.781042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.794478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:03:57.795665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 621/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:03:57.801495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:57.894615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83b11c-08ef-4796-a02f-40007fc1b4f9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:57.926940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:57.927654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:57.927934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:57.928206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:57.928965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:57.929270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:57.930669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c5c0-12c5-4bcb-bbc5-fe1d72ba51b2 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:57.941903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 624/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:03:57.947871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:03:58.043921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46745-0934-46a7-8d41-1514e3a53672 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:03:58.074938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:03:58.075604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:03:58.075889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:03:58.076167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:03:58.076985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] RBAC: Adding query filter params (role.id=c7381c2b235546bab96b17d27010b5eb, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=3d3c0373ebde41b9aac512bf44553b4f) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:03:58.077299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:03:58.078716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2ea3a-5655-4acc-919d-52a0116adccc None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:03:58.084373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 622/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:03:57 2022] GET /identity/v3/role_assignments?user.id=3d3c0373ebde41b9aac512bf44553b4f&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=c7381c2b235546bab96b17d27010b5eb => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:00.411714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab8c-3b76-493f-9265-18d9ab46f41c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:00.412234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab8c-3b76-493f-9265-18d9ab46f41c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:00.412234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab8c-3b76-493f-9265-18d9ab46f41c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:00.413584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 625/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:00.419273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:00.419784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:00.419871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:00.444289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:00.444289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:00.499617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 623/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:00.523319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ab8c-3b76-493f-9265-18d9ab46f41c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:00.619181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ab8c-3b76-493f-9265-18d9ab46f41c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:00.652098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:00.652922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:00.653203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:00.653477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:00.665120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:04:00.672902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:04:00.674300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 626/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:00.680787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:00.775952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f688e0-5b8a-4005-a369-d1290c2db794 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:00.807643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:00.808308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:00.808593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:00.808876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:00.809617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:00.809925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:00.811289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:00.818938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 624/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:00.825149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:00.920114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e41d-a189-4dd2-95e8-083c71bbdf1d None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:00.952492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:00.953270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:00.953561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:00.953839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:00.963884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:00.965330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:00.982323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:00.983545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 627/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:00.989373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:01.084990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dd73f-06d4-4e71-887c-bd5072ff1444 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:01.116449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:01.117100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:01.117384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:01.117662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:01.118377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:01.119266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:01.120662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:01.132023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 625/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:01.138444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:01.235994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567b4c-9f9f-4464-9653-464edcc9b6f0 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:01.271830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:01.272653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:01.272954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:01.273217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:01.281212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:01.282648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:01.296805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:04:01.297984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 628/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:01.304293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:01.399609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5d1f-b3dd-4be0-a41b-84098b82907c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:01.432080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:01.432735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:01.433014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:01.433286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:01.434138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:01.434518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:01.435971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:01.452662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 626/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:04:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:01.458386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:01.558236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed595-9778-42d9-8ddc-90b4f690d4e9 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:01.589428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:01.590075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:01.590351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:01.590624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:01.653754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:01.655118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:01.745920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 629/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:04:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:04:01.752006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:01.846774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261fdc6-8f82-4e47-a196-a8fc0245f181 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:01.878420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:01.879198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:01.879502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:01.879786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:01.889987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:01.891422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:01.908039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:01.909153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 627/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:01.914975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:02.008644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7a14-c566-4753-8851-0c59f232829b None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:02.041572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:02.042225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:02.042503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:02.042779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:02.043500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:02.043820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:02.045173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:02.055884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 630/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:02.062907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:02.157582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb756f-91b0-4db7-8c8e-9f865f90aba1 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:02.189559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:02.190397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:02.191576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:02.191576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:02.198066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:02.199533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:02.212993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:04:02.214170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 628/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:02.220201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:02.314757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bfcf-b204-40fa-ba60-80d34d717847 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:02.351950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:02.352615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:02.353049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:02.353330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:02.354120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:02.354433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:02.355889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab9ae-8e14-4f04-8099-e1a9b27aac60 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:02.367286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 631/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:02.373334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:02.469671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313c8a-a88d-4176-b8dc-aef7f035c723 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:02.501596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:02.502231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:02.502662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:02.502958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:02.503794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=3d3c0373ebde41b9aac512bf44553b4f) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:02.504107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:02.505529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ecdb-793c-429b-8bae-a4bbc99a38d4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:02.511540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 629/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:04:02 2022] GET /identity/v3/role_assignments?user.id=3d3c0373ebde41b9aac512bf44553b4f&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:04.789171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139454c8-0024-4aa9-a67e-68a555cb970e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:04.789723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139454c8-0024-4aa9-a67e-68a555cb970e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:04.789723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139454c8-0024-4aa9-a67e-68a555cb970e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:04.791118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 632/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:04:04.796339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:04.796739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:04.796891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:04.813813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:04.814993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:04.877685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 630/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:04.900963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139454c8-0024-4aa9-a67e-68a555cb970e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:04.996603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139454c8-0024-4aa9-a67e-68a555cb970e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.028390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.029175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.029452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.029722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.039528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:04:05.047076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:04:05.048287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 633/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:05.055746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.147647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47b2b-17c0-48d4-951c-161ef92cf16e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.179963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.180622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.181501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.181785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.182540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:05.182843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.184221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.285564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 631/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:05.285766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.297600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2d219-7c4d-497c-9340-79e2402d2329 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.328873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.329682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.329966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.330236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.340188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.341611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.358309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:05.359503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 634/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:05.365255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.462740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cc178-7c55-4db4-b933-ca6661937579 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.494394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.495048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.495331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.495637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.496358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:05.496665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.498053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.509123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 632/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:05.514803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.610383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93c236-270c-43df-97c8-381eec611ba1 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.641280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435571a-e135-472f-9436-68456d469a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.642068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435571a-e135-472f-9436-68456d469a84 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.642345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435571a-e135-472f-9436-68456d469a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.642613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435571a-e135-472f-9436-68456d469a84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.650533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435571a-e135-472f-9436-68456d469a84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.651975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435571a-e135-472f-9436-68456d469a84 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.665101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-5435571a-e135-472f-9436-68456d469a84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:04:05.666829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 635/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:05.672833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.766197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732baa0-0e30-4994-9b20-fdf7136a4e33 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.798878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.799560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.799839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.800107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.800934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:05.801247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.802655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.818632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 633/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:05.825520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435571a-e135-472f-9436-68456d469a84 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:05.921992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435571a-e135-472f-9436-68456d469a84 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:05.954182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:05.954963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:05.955244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:05.955544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:05.966114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:05.967566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:05.983695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:05.984860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 636/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:05.990497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:06.083680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0eb2-890b-434b-90f3-021877aea78a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:06.116530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:06.117177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:06.117457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:06.117727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:06.118439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:06.118741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:06.120120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:06.130791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 634/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:06.136948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:06.233105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eee84-fec3-439a-aa57-f33453c70463 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:06.266258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:06.267048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:06.267331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:06.267638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:06.274493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:06.280922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:06.289156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:04:06.290300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 637/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:06.296269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:06.396174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f14b79-5675-4e36-848f-d2adcfb8ba58 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:06.429338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:06.430004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:06.430326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:06.430608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:06.431437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:06.434987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:06.434987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ea0ca-d162-433b-9421-4a4c282c4110 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:06.445274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 635/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:06.451286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:06.547336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c857a-fdb8-4d04-b9ae-4c78b240e0b7 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:06.580013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:06.580922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:06.581203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:06.581483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] PATH_INFO: `/v3/projects/77adf95580be4bdc84d9332712e64813/users/3d3c0373ebde41b9aac512bf44553b4f/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:06.583437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=77adf95580be4bdc84d9332712e64813, user_id=3d3c0373ebde41b9aac512bf44553b4f, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:06.584967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3fcab-2029-4d40-b4ea-2d36da8b9d94 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:06.652321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 638/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 12 08:04:06 2022] PUT /identity/v3/projects/77adf95580be4bdc84d9332712e64813/users/3d3c0373ebde41b9aac512bf44553b4f/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:04:08.884957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da038-148f-4751-ba5b-5163cf529c33 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:08.885569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da038-148f-4751-ba5b-5163cf529c33 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:08.885569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da038-148f-4751-ba5b-5163cf529c33 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:08.886850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 636/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:08.891997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:08.892406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:08.892557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:08.909466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:08.910632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:08.973549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 639/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:08.998419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da038-148f-4751-ba5b-5163cf529c33 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.095952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da038-148f-4751-ba5b-5163cf529c33 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.127927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.128705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.128986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.129254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.138865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 08:04:09.145865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 08:04:09.147029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 637/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 12 08:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:09.153825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.246386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d49d-bddc-41ed-af0c-a4150ffc67a3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.279088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.279787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.280080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.280359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.281099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:09.281407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:09.282771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:09.290478 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 640/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:09.296228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.393698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ff4-8e2b-461b-899e-763e054d5148 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.426294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.427075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.427359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.427669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.437998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:09.439819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:09.456674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:09.457818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 638/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:09.464389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.560635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1b87-72d6-461e-83d5-2e9ed0c45231 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.595316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.596008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.596293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.596580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.597286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:09.597598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:09.598961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:09.610521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 641/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:09.616463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.711136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b3392-3be8-49ff-80a6-c136aab7d372 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.742238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.743075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.743358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.743659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.752507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:09.753190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:09.767149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 08:04:09.768339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 639/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:09.774751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:09.869878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4efba-ab8f-4b0c-8521-69d68b3bf351 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:09.906916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:09.907644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:09.907908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:09.908180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:09.909039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:09.909356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:09.910817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:09.930315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 642/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:09.936774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.042207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a03-2572-48ef-b958-d6f60635b2a0 None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:10.076360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:10.077029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:10.077312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:10.077583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:10.150263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:10.151839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:10.255902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 640/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 12 08:04:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 08:04:10.261764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.373210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4d410-613b-4674-b803-4113f3fbdb2e None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:10.406374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:10.407169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:10.407482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:10.407762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:10.417334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:10.418769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:10.435386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 08:04:10.436594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 643/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:10.442827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.536910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0bfa-72ef-4dfe-9bbd-779f55d8dc0d None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:10.570233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:10.570882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:10.571164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:10.571439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:10.572197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:10.572504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:10.573857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:10.584447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 641/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 12 08:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:04:10.590834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.690773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13abdb-89a3-458e-b0a8-4993915c331a None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:10.723538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:10.724316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:10.724596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:10.724865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:10.731165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:10.732657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:10.745218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING keystone.server.flask.application [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 08:04:10.746361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 644/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 12 08:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:10.752255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.847133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad382-d1a1-4790-b5a1-57875f7b121a None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:10.877738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:10.878380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:10.878660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:10.878931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:10.879737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:10.880041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:10.881459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fa8e4-4e2e-4d4b-8d89-e5118332c961 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:10.893423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 642/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 12 08:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:10.899688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:10.998620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bea63-e85f-4ee4-b337-69dea4277afc None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:11.031096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:11.031765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:11.032050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:11.032322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:11.033133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] RBAC: Adding query filter params (role.id=62d99ec236024c42b980e2afdcd9b18a, scope.project.id=77adf95580be4bdc84d9332712e64813, user.id=3d3c0373ebde41b9aac512bf44553b4f) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:11.033440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:11.034848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13188-5b5e-4122-8db2-42693b94b85b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:11.040377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 645/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 12 08:04:10 2022] GET /identity/v3/role_assignments?user.id=3d3c0373ebde41b9aac512bf44553b4f&scope.project.id=77adf95580be4bdc84d9332712e64813&role.id=62d99ec236024c42b980e2afdcd9b18a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:13.343248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e9da-5f6c-4f2c-b37f-69d5fb942217 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:13.343851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e9da-5f6c-4f2c-b37f-69d5fb942217 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:13.343851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e9da-5f6c-4f2c-b37f-69d5fb942217 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:13.345196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 643/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:13.350261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:13.350660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:13.350829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:13.367036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:13.370648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:13.432737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 646/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:13.454959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e9da-5f6c-4f2c-b37f-69d5fb942217 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:13.550205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e9da-5f6c-4f2c-b37f-69d5fb942217 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:13.582416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:13.583195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:13.583496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:13.583769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:13.584556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:13.585907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:13.596792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 08:04:13.597932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 644/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:04:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:13.605162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:13.698240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62bc3-a40a-4a72-bc67-a87ee5994a8f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:13.730244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:13.730843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:13.731128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:13.731402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:13.732129 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:13.732442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:13.733791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9fe40-88b9-4ab4-8a4c-4138ba130a0b None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:13.738409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 647/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 12 08:04:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:13.744912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:13.838309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2f90-ea88-4b98-aaa1-2f2bdfe4dd6c None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:13.870644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:13.871292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:13.871608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:13.871888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] PATH_INFO: `/v3/services` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:13.872590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:13.872898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:13.874260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128a7e-3e97-4db3-b967-f5f5776e66a4 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:13.878523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 645/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 12 08:04:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:16.137713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02e80-78ea-4160-b6bc-b0ece2ab0c92 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:16.138282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02e80-78ea-4160-b6bc-b0ece2ab0c92 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:16.138282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02e80-78ea-4160-b6bc-b0ece2ab0c92 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:16.139667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 648/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:16.144887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d60d-8b86-44f8-88a7-922d91be2f07 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:16.145307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d60d-8b86-44f8-88a7-922d91be2f07 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:16.145425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d60d-8b86-44f8-88a7-922d91be2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:16.162396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4a43d60d-8b86-44f8-88a7-922d91be2f07 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:16.163592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4a43d60d-8b86-44f8-88a7-922d91be2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:16.230132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 646/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:16.253674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02e80-78ea-4160-b6bc-b0ece2ab0c92 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:16.356297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02e80-78ea-4160-b6bc-b0ece2ab0c92 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:16.396799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:16.397409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:16.397690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:16.397961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:16.398669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:16.400356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bea7bf-cd3f-4b08-a37b-10cb5b63f1aa None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:16.521582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 649/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 12 08:04:16 2022] POST /identity/v3/services => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:04:18.795453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc343d-1bbb-423b-866e-8ae8ef356ea6 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:18.796023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc343d-1bbb-423b-866e-8ae8ef356ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:18.796023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc343d-1bbb-423b-866e-8ae8ef356ea6 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:18.797397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 647/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:18.802423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:18.802858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:18.802965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:18.819074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:18.820284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:18.888189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 650/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 08:04:18.912417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc343d-1bbb-423b-866e-8ae8ef356ea6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:19.006774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc343d-1bbb-423b-866e-8ae8ef356ea6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:19.038997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:19.039846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:19.040125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:19.040397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:19.041095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:19.042442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:19.053282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 08:04:19.054404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 648/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:04:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:19.060448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:19.152848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d856b6-6f84-4919-9c94-ed1fac6f2a23 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:19.183987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:19.184648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:19.184926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:19.185195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:19.185883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:19.186281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:19.187539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:19.192462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 651/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 12 08:04:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:19.198911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:19.294526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea845493-f404-486e-bba2-cb0c4494b39f None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:19.326980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:19.327661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:19.327948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:19.328225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:19.329014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] RBAC: Adding query filter params (interface=public, service_id=cc308d426a2f4f6cb32bba243e801ce5, region_id=RegionOne) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:19.329331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:19.330696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea0c6-e097-48a3-b414-2d11b623cab2 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:19.335756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 649/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 12 08:04:19 2022] GET /identity/v3/endpoints?service_id=cc308d426a2f4f6cb32bba243e801ce5&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:04:19.341192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:19.435720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35b48-b248-4003-8535-1c187e124835 None admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:19.468138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:19.468783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:19.469064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:19.469333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:19.469990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:19.471333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227732-a21d-4b9b-ba96-c240189d7622 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:19.477920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 652/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 12 08:04:19 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:04:21.761239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7928c-6eea-40ff-975b-6cc2b0ca2efc None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:21.761788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7928c-6eea-40ff-975b-6cc2b0ca2efc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:21.761788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7928c-6eea-40ff-975b-6cc2b0ca2efc None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:21.763137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 650/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:04:21.768734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:21.769125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:21.769289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:21.786049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:04:21.787195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:04:21.850119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 653/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:04:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 08:04:21.874017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7928c-6eea-40ff-975b-6cc2b0ca2efc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:21.970243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7928c-6eea-40ff-975b-6cc2b0ca2efc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:22.002846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:22.003665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:22.003948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:22.004221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:22.004859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:22.006220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:22.020985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING keystone.server.flask.application [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 08:04:22.020985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 651/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 12 08:04:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 08:04:22.024700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:22.121986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e225e49-dbb7-499e-9b6d-ec204e19b764 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:22.154758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:22.155411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:22.155727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:22.156007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] PATH_INFO: `/v3/services` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:22.156697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:04:22.157000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:22.158348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcb32f-c21a-4f00-b748-92ebc97db343 None admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:22.163299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 654/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 12 08:04:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:04:22.169185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:04:22.263580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a045ac-d018-4388-8003-4b682259d00e None admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:04:22.295379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:04:22.295981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:04:22.296264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:04:22.296540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:04:22.297285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:04:22.298639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6929ff-1c01-4437-90fa-a6cc01f03176 None admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:04:22.418785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 652/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 12 08:04:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:10:33.244173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3deb-c07f-4491-acae-6e4300522bd5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:33.245968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3deb-c07f-4491-acae-6e4300522bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:33.255073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3deb-c07f-4491-acae-6e4300522bd5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:33.255073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 655/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:33.261681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ef9-3e3a-44de-83e8-f3eff72b1697 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:33.263102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ef9-3e3a-44de-83e8-f3eff72b1697 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:33.264064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ef9-3e3a-44de-83e8-f3eff72b1697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:33.415458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e97d0ef9-3e3a-44de-83e8-f3eff72b1697 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:33.417087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e97d0ef9-3e3a-44de-83e8-f3eff72b1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:33.555500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 653/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:33.597781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668278c5-7742-464f-830e-f96204c927b5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:33.598399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668278c5-7742-464f-830e-f96204c927b5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:33.598893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668278c5-7742-464f-830e-f96204c927b5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:33.600481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 656/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue Apr 12 08:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:33.607501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f87b6-de15-4f7a-b359-1bd0b94ccac7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:33.607798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f87b6-de15-4f7a-b359-1bd0b94ccac7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:33.608077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f87b6-de15-4f7a-b359-1bd0b94ccac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:33.686046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-481f87b6-de15-4f7a-b359-1bd0b94ccac7 None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:33.687236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-481f87b6-de15-4f7a-b359-1bd0b94ccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:33.766884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 654/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Apr 12 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:33.775865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668278c5-7742-464f-830e-f96204c927b5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:33.778189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-668278c5-7742-464f-830e-f96204c927b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:33.899937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668278c5-7742-464f-830e-f96204c927b5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:33.977121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:33.978179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:33.978667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:33.979870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:33.982378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:34.093801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:34.095840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29750c2b-e718-4d10-9248-6ce5ef7d6cfd service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:34.118519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 657/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:36.746422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:36.746978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:36.746978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:36.748580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 655/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:36.753557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757db3ec-69b9-4a44-b889-11e70b1b5b6e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:36.754384 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757db3ec-69b9-4a44-b889-11e70b1b5b6e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:36.754648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757db3ec-69b9-4a44-b889-11e70b1b5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:36.844888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-757db3ec-69b9-4a44-b889-11e70b1b5b6e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:36.846099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-757db3ec-69b9-4a44-b889-11e70b1b5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:36.938876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 658/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:36.977709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:36.979266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:37.079737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85af7-2bed-437a-a3b1-6ced580e19d9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:37.149733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:37.150379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:37.150719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:37.150990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:37.152897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:37.260094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:37.262087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc8c44-0ef0-4d38-8980-77e1b2e5278d service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:37.282953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 656/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:40.082288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:40.082817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:40.082935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:40.084230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 659/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:40.089768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7b6e-6eeb-4dd8-bf20-8333ebf106c6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:40.090170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7b6e-6eeb-4dd8-bf20-8333ebf106c6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:40.090312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7b6e-6eeb-4dd8-bf20-8333ebf106c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:40.152725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c07c7b6e-6eeb-4dd8-bf20-8333ebf106c6 None None] MFA Rules not processed for user `d89331b4cbbf45aa9d8f13cdb096ad69`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:40.153939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c07c7b6e-6eeb-4dd8-bf20-8333ebf106c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:40.244091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 657/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:40.284995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:40.286520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:40.410122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c888-f6f6-4a40-85ee-ee5b1c12fefd None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:40.480163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:40.480801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:40.481080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:40.481349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:40.482954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:40.583854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:40.585265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96504d0e-47ba-4b6e-a0a6-de4e58a02548 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:40.603115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 660/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:43.660598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:43.661136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:43.661136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:43.662507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 658/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:43.667841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ceb-a7d2-4eb4-85fd-d30f1ce471f8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:43.668280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ceb-a7d2-4eb4-85fd-d30f1ce471f8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:43.668382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ceb-a7d2-4eb4-85fd-d30f1ce471f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:43.729575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-763d3ceb-a7d2-4eb4-85fd-d30f1ce471f8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:43.730756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-763d3ceb-a7d2-4eb4-85fd-d30f1ce471f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:43.824268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 661/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:43.862331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:43.863871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:43.961027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b77e6-704a-4740-9ca3-d7f3816020f4 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:44.029000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:44.029632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:44.029911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:44.030180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:44.031803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:44.132570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:44.133978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001001c-b550-4f19-8999-80b8bddab155 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:44.150727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 659/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:47.407204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:47.407692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:47.408256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:47.409145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 662/1321] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:47.414409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aad11-a12a-41b6-99f1-dcde57130f84 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:47.414811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aad11-a12a-41b6-99f1-dcde57130f84 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:47.414983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aad11-a12a-41b6-99f1-dcde57130f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:47.477950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a74aad11-a12a-41b6-99f1-dcde57130f84 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:47.479098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a74aad11-a12a-41b6-99f1-dcde57130f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:47.571334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 660/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:47.608437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:47.610061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:47.708724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2bd00-eea2-4349-8795-a8ceba6f5966 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:47.778937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:47.779525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:47.779808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:47.780081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:47.781689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:47.885246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:47.886670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b1c8-7298-4e25-8bc5-5cd828dbfeac service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:47.908501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 663/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:10:50.245435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db907-cfdf-4ddb-b064-d315340d49d0 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:50.245949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db907-cfdf-4ddb-b064-d315340d49d0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:50.246071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db907-cfdf-4ddb-b064-d315340d49d0 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:50.247403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 661/1324] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:50.252629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc4a3-3b20-43f0-81fb-9c4c893cc48b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:50.253018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc4a3-3b20-43f0-81fb-9c4c893cc48b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:50.253186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc4a3-3b20-43f0-81fb-9c4c893cc48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:50.317758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b75fc4a3-3b20-43f0-81fb-9c4c893cc48b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:50.318947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b75fc4a3-3b20-43f0-81fb-9c4c893cc48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:50.413964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 664/1325] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:50.465232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:50.465518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:50.465791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:50.467155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 662/1326] 10.222.0.23 () {54 vars in 964 bytes} [Tue Apr 12 08:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:50.473226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0707-a16b-414d-8a9f-9aeed7b7a8bb None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:50.473600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0707-a16b-414d-8a9f-9aeed7b7a8bb None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:50.473948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0707-a16b-414d-8a9f-9aeed7b7a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:50.548714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-647c0707-a16b-414d-8a9f-9aeed7b7a8bb None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:50.549983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-647c0707-a16b-414d-8a9f-9aeed7b7a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:50.622209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 665/1327] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Apr 12 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:50.631110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:50.632757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:50.741217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52800-f2a3-4260-b10a-b38dcda8ef0f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:50.810824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:50.811463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:50.811777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:50.812055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:50.813673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:50.917801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:50.919246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69946-370e-4ab0-a8ee-e27866644776 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:50.936808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 663/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:53.532381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:53.532938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:53.532938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:53.534199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 666/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:53.539795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89501-3ee2-4a12-8301-eb7c23eb5cc2 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:53.540272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89501-3ee2-4a12-8301-eb7c23eb5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:53.540362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89501-3ee2-4a12-8301-eb7c23eb5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:53.605506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b3d89501-3ee2-4a12-8301-eb7c23eb5cc2 None None] MFA Rules not processed for user `d89331b4cbbf45aa9d8f13cdb096ad69`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:53.606723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b3d89501-3ee2-4a12-8301-eb7c23eb5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:53.707097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 664/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:53.746004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:53.747675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:53.859847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fbea7-c599-4e07-a0d8-604d1d1ddda3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:53.937799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:53.938450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:53.938735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:53.939010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:53.940678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:54.055401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:54.056888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e3ba-cf8a-4425-bba1-e6c471deab0c service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:54.074648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 667/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:56.976968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:56.977412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:56.977515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:56.979363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 665/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:56.984500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76328-6a62-4999-b6e6-8dd4bc1c6c24 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:56.984942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76328-6a62-4999-b6e6-8dd4bc1c6c24 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:56.985063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76328-6a62-4999-b6e6-8dd4bc1c6c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:57.059824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f1b76328-6a62-4999-b6e6-8dd4bc1c6c24 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:57.061046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f1b76328-6a62-4999-b6e6-8dd4bc1c6c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:57.153484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 668/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:10:57.190979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:10:57.192617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:57.292930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41f159-ddb1-4065-a96d-de259707c5d6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:10:57.369174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:10:57.369820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:57.370103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:57.370378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:57.372042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:10:57.486778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:10:57.488262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bdaa1-9802-45f0-a52d-abb2535f7d47 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:10:57.506351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 666/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:10:59.898259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:59.898768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:59.898860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:59.900239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 669/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:10:59.905613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b5d7-56dd-4a0b-804e-ed5430888b9d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:10:59.906021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b5d7-56dd-4a0b-804e-ed5430888b9d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:10:59.906186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b5d7-56dd-4a0b-804e-ed5430888b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:10:59.968968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e1a5b5d7-56dd-4a0b-804e-ed5430888b9d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:10:59.970161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e1a5b5d7-56dd-4a0b-804e-ed5430888b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:00.061992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 667/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:00.103559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:00.105113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:00.204706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd5bb9-fa7f-48b1-be9b-22df058724de None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:00.275844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:00.276493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:00.276776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:00.277051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:00.278937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:00.382185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:00.383647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990745d-ce4b-4c4c-ba06-b4b34d7f503c service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:00.401769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 670/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:03.213312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:03.213763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:03.213875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:03.215256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 668/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:03.220350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c2e2a-962a-47e7-86b3-23519930bdd8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:03.220751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c2e2a-962a-47e7-86b3-23519930bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:03.220908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c2e2a-962a-47e7-86b3-23519930bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:03.282727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-839c2e2a-962a-47e7-86b3-23519930bdd8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:03.283944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-839c2e2a-962a-47e7-86b3-23519930bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:03.383415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 671/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:03.418776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:03.421822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:03.535531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4743b55-7bb9-4934-a460-ae7b6f5bca5d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:03.539092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:03.540740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:03.540740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:03.540740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:03.542419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:03.642373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:03.643828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fb01c-085f-4a5f-80fc-75a87ede9a67 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:03.662959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 669/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:08.331844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:08.332366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:08.332366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:08.333674 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 672/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:08.339717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6745-fc07-49bd-bdf0-9c1d5ec81479 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:08.340154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6745-fc07-49bd-bdf0-9c1d5ec81479 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:08.340396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6745-fc07-49bd-bdf0-9c1d5ec81479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:08.385291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b12b6745-fc07-49bd-bdf0-9c1d5ec81479 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:08.386483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b12b6745-fc07-49bd-bdf0-9c1d5ec81479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:08.460124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 670/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:08.500313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:08.502408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:08.516295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c617-304e-4836-804a-2cfaa518ac1a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:08.519787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:08.520421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:08.520706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:08.520983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:08.530181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:08.531652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeb7a3-cae1-47ab-9469-f3dec6a431d0 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:08.541089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 673/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:11.779699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949d0f-f948-45c5-a416-ecf469976db0 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:11.780235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949d0f-f948-45c5-a416-ecf469976db0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:11.780324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949d0f-f948-45c5-a416-ecf469976db0 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:11.781647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 671/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:11.786890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352d1c-2ef0-4124-8f65-b971a9f5a2d7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:11.787333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352d1c-2ef0-4124-8f65-b971a9f5a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:11.787447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352d1c-2ef0-4124-8f65-b971a9f5a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:11.814913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-84352d1c-2ef0-4124-8f65-b971a9f5a2d7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:11.816122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-84352d1c-2ef0-4124-8f65-b971a9f5a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:11.825026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 674/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:11.865252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb949d0f-f948-45c5-a416-ecf469976db0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:11.876449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb949d0f-f948-45c5-a416-ecf469976db0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:11.879933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:11.880569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:11.880852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:11.881129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:11.889829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:11.891273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6cb4a-3a9c-4f90-a18d-7075c3f55fa6 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:11.900474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 672/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:16.775385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6e18-2775-4ebe-9bf7-0f8e6d9a1e2d None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:16.775982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6e18-2775-4ebe-9bf7-0f8e6d9a1e2d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:16.776078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6e18-2775-4ebe-9bf7-0f8e6d9a1e2d None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:16.777406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 675/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:16.782978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70cb94-4ef2-4dd8-9c62-a05022766231 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:16.783431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70cb94-4ef2-4dd8-9c62-a05022766231 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:16.783544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70cb94-4ef2-4dd8-9c62-a05022766231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:16.802769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9e70cb94-4ef2-4dd8-9c62-a05022766231 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:16.804005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9e70cb94-4ef2-4dd8-9c62-a05022766231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:16.812654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 673/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:16.851695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca6e18-2775-4ebe-9bf7-0f8e6d9a1e2d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:16.862101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca6e18-2775-4ebe-9bf7-0f8e6d9a1e2d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:16.865621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:16.866252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:16.866530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:16.866803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:16.876066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:16.877490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812231da-e596-4420-8015-2d082f298a5a service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:16.887521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 676/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:22.215947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb32ee-f9b2-4519-ae44-c51107fed014 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:22.217065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb32ee-f9b2-4519-ae44-c51107fed014 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:22.217596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb32ee-f9b2-4519-ae44-c51107fed014 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:22.219456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 674/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:22.225072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a443c-56d9-4034-900a-2d575fb20237 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:22.225486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a443c-56d9-4034-900a-2d575fb20237 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:22.225624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a443c-56d9-4034-900a-2d575fb20237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:22.298235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-075a443c-56d9-4034-900a-2d575fb20237 None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:22.301355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-075a443c-56d9-4034-900a-2d575fb20237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:22.373661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 677/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:26.717211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ebb-09c8-493d-8843-2660b3b276b5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:26.718112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ebb-09c8-493d-8843-2660b3b276b5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:26.718388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ebb-09c8-493d-8843-2660b3b276b5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:26.719994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 675/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:26.724808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1d98-b931-4b53-a3eb-68d1ed5981a7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:26.725673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1d98-b931-4b53-a3eb-68d1ed5981a7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:26.726160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1d98-b931-4b53-a3eb-68d1ed5981a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:26.746729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8cee1d98-b931-4b53-a3eb-68d1ed5981a7 None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:26.748763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8cee1d98-b931-4b53-a3eb-68d1ed5981a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:26.758899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 678/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:11:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:28.330614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493388-0dfb-4ea0-9913-204dfdb3b9a7 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:28.331160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493388-0dfb-4ea0-9913-204dfdb3b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:28.331160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493388-0dfb-4ea0-9913-204dfdb3b9a7 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:28.332606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 676/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:28.338071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb832f6-227f-4f8f-a1af-10e8b051687a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:28.338866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb832f6-227f-4f8f-a1af-10e8b051687a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:28.339145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb832f6-227f-4f8f-a1af-10e8b051687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:28.357533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7bb832f6-227f-4f8f-a1af-10e8b051687a None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:28.358715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7bb832f6-227f-4f8f-a1af-10e8b051687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:28.367985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 679/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:32.215859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ef7f-f3fc-4ee8-9340-e5c61459c2a3 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:32.216322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ef7f-f3fc-4ee8-9340-e5c61459c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:32.216415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ef7f-f3fc-4ee8-9340-e5c61459c2a3 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:32.217928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 677/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:32.222891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a4481-61d2-48d2-aac7-8aeb2e96d739 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:32.223282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a4481-61d2-48d2-aac7-8aeb2e96d739 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:32.223442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a4481-61d2-48d2-aac7-8aeb2e96d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:32.240607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-236a4481-61d2-48d2-aac7-8aeb2e96d739 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:32.241770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-236a4481-61d2-48d2-aac7-8aeb2e96d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:32.249484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 680/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:32.302129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec53e5-12db-4d06-af34-933a1cdc9e73 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:32.302420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec53e5-12db-4d06-af34-933a1cdc9e73 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:32.302703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec53e5-12db-4d06-af34-933a1cdc9e73 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:32.304248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 678/1358] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:11:32.309514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c18b-9e72-4971-8839-b36911ed0cf5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:32.309808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c18b-9e72-4971-8839-b36911ed0cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:32.310084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c18b-9e72-4971-8839-b36911ed0cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:32.357828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-aa78c18b-9e72-4971-8839-b36911ed0cf5 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:32.359025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-aa78c18b-9e72-4971-8839-b36911ed0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:32.438920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 681/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:32.472727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec53e5-12db-4d06-af34-933a1cdc9e73 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:32.489587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec53e5-12db-4d06-af34-933a1cdc9e73 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:32.495869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:32.496642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:32.497060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:32.497431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:32.506567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:32.508992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113a240-588c-486e-90ef-9f1f25fd9ba1 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:32.519361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 679/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:35.036122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d536-3559-4482-aca6-6228ebeaf5a3 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:35.037047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d536-3559-4482-aca6-6228ebeaf5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:35.037625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d536-3559-4482-aca6-6228ebeaf5a3 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:35.039659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 682/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:35.044832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25eebd-c50d-4f21-b339-39713af34b31 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:35.045627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25eebd-c50d-4f21-b339-39713af34b31 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:35.046062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25eebd-c50d-4f21-b339-39713af34b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:35.064326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0e25eebd-c50d-4f21-b339-39713af34b31 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:35.065591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0e25eebd-c50d-4f21-b339-39713af34b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:35.074057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 680/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:35.120496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d536-3559-4482-aca6-6228ebeaf5a3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:35.135244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d536-3559-4482-aca6-6228ebeaf5a3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:35.141302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:35.142026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:35.142374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:35.142716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:35.151813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:35.153726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceed8-4070-4b8e-a507-b44d14274a00 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:35.163508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 683/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:37.905957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767874-b64c-449d-a53a-010fa024da98 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:37.906466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767874-b64c-449d-a53a-010fa024da98 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:37.906576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767874-b64c-449d-a53a-010fa024da98 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:37.908086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 681/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:37.913225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c294-daa4-411c-b804-622da9fa0a50 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:37.914245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c294-daa4-411c-b804-622da9fa0a50 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:37.914335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c294-daa4-411c-b804-622da9fa0a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:37.932191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b467c294-daa4-411c-b804-622da9fa0a50 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:37.933286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b467c294-daa4-411c-b804-622da9fa0a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:37.941096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 684/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:37.994557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ad0ed-18a3-4f02-8591-7cf4c923fcde None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:37.995057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ad0ed-18a3-4f02-8591-7cf4c923fcde None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:37.995335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ad0ed-18a3-4f02-8591-7cf4c923fcde None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:37.996732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 682/1366] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:38.002234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679125-f150-46c7-95f9-e59f9d8dbe24 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:38.002595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679125-f150-46c7-95f9-e59f9d8dbe24 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:38.002938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679125-f150-46c7-95f9-e59f9d8dbe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:38.021066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b6679125-f150-46c7-95f9-e59f9d8dbe24 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:38.022264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b6679125-f150-46c7-95f9-e59f9d8dbe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:38.032186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 685/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:38.040636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ad0ed-18a3-4f02-8591-7cf4c923fcde None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:38.055585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ad0ed-18a3-4f02-8591-7cf4c923fcde None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:38.070249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:38.070901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:38.071184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:38.071461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:38.080356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:38.081954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b65950-2abd-47c0-82ae-152ddc6dac9b service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:38.099548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 683/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:40.493079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a676f-cc67-4bd4-ab1d-d457a31727e5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.493916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a676f-cc67-4bd4-ab1d-d457a31727e5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.494203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a676f-cc67-4bd4-ab1d-d457a31727e5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.495562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 686/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:40.500867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5e8b9-966b-4c51-bca7-89cb3589cec4 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.501288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5e8b9-966b-4c51-bca7-89cb3589cec4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.501636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5e8b9-966b-4c51-bca7-89cb3589cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.519585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f9b5e8b9-966b-4c51-bca7-89cb3589cec4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:40.520764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f9b5e8b9-966b-4c51-bca7-89cb3589cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:40.529034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 684/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:40.626910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b77b-2232-4f75-aff8-a35d94b07fbc None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.627194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b77b-2232-4f75-aff8-a35d94b07fbc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.627687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b77b-2232-4f75-aff8-a35d94b07fbc None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.629275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 687/1371] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:40.634457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52b0d-121a-4706-b415-fd4baaa1be90 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.634752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52b0d-121a-4706-b415-fd4baaa1be90 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.635034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52b0d-121a-4706-b415-fd4baaa1be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.652830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fbd52b0d-121a-4706-b415-fd4baaa1be90 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:40.654020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fbd52b0d-121a-4706-b415-fd4baaa1be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:40.662068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 685/1372] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:40.709222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b77b-2232-4f75-aff8-a35d94b07fbc None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:40.724622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b77b-2232-4f75-aff8-a35d94b07fbc None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:40.730821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:40.731517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.731809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.732090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.740394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:40.741975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c9d94-25d7-4011-9b83-733333e6f7d3 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:40.752117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 688/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:40.804378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a5ed-8ba0-443f-80f4-09af320ccbd1 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.804694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a5ed-8ba0-443f-80f4-09af320ccbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.805023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a5ed-8ba0-443f-80f4-09af320ccbd1 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.806476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 686/1374] 10.222.0.23 () {54 vars in 962 bytes} [Tue Apr 12 08:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:40.811454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a64a-6696-4132-8737-476a5c7b4990 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.811822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a64a-6696-4132-8737-476a5c7b4990 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.812165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a64a-6696-4132-8737-476a5c7b4990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.865645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5c87a64a-6696-4132-8737-476a5c7b4990 None None] MFA Rules not processed for user `b877e3bebb09444381fdee3fdbe4be24`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:40.867005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5c87a64a-6696-4132-8737-476a5c7b4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:40.930502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 689/1375] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Apr 12 08:11:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:40.939342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a5ed-8ba0-443f-80f4-09af320ccbd1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:40.951356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a5ed-8ba0-443f-80f4-09af320ccbd1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:40.955678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:40.956596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:40.957046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:40.957632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:40.969049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:40.970933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31decf-3673-401b-b5fd-2b2840bf2669 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:40.983177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 687/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:11:43.245548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ee5a-1d6b-4246-abb8-ca1a90afade2 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:43.246057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ee5a-1d6b-4246-abb8-ca1a90afade2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:43.246175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ee5a-1d6b-4246-abb8-ca1a90afade2 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:43.247516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 690/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:43.253153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f624-65e0-427b-9eef-d816fc49b0c3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:43.253618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f624-65e0-427b-9eef-d816fc49b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:43.253719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f624-65e0-427b-9eef-d816fc49b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:43.271860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-49f5f624-65e0-427b-9eef-d816fc49b0c3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:43.273037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-49f5f624-65e0-427b-9eef-d816fc49b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:43.281132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 688/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:43.327085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ee5a-1d6b-4246-abb8-ca1a90afade2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:43.356539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ee5a-1d6b-4246-abb8-ca1a90afade2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:43.356539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:43.356539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:43.357158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:43.357158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:43.365964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:43.368342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02924b3-3113-44cd-984a-79ac6268acbc service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:43.378658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 691/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:45.827937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161256-1b76-4f6f-b797-a9bd265f25bb None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:45.828488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161256-1b76-4f6f-b797-a9bd265f25bb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:45.828488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161256-1b76-4f6f-b797-a9bd265f25bb None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:45.829831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 689/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:45.836002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280fd76-b868-4f94-b225-e64a22202db8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:45.836440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280fd76-b868-4f94-b225-e64a22202db8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:45.836547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280fd76-b868-4f94-b225-e64a22202db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:45.853855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8280fd76-b868-4f94-b225-e64a22202db8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:45.855020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8280fd76-b868-4f94-b225-e64a22202db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:45.862770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 692/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:45.908622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161256-1b76-4f6f-b797-a9bd265f25bb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:45.923555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161256-1b76-4f6f-b797-a9bd265f25bb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:45.929470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:45.930116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:45.930402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:45.930683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:45.939428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:45.941070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeba0b-7db8-40e8-8076-15940cab1105 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:45.951732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 690/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:48.419495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e438e1-4c90-4c01-a4aa-05bc2415ea31 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:48.419929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e438e1-4c90-4c01-a4aa-05bc2415ea31 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:48.420071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e438e1-4c90-4c01-a4aa-05bc2415ea31 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:48.421590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 693/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:48.426661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfef5a-811c-48ce-9245-3899dfdd128f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:48.427101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfef5a-811c-48ce-9245-3899dfdd128f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:48.427286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfef5a-811c-48ce-9245-3899dfdd128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:48.445086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dbdfef5a-811c-48ce-9245-3899dfdd128f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:48.446463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dbdfef5a-811c-48ce-9245-3899dfdd128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:48.455836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 691/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:48.498257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e438e1-4c90-4c01-a4aa-05bc2415ea31 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:48.513283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e438e1-4c90-4c01-a4aa-05bc2415ea31 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:48.518673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:48.519440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:48.519877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:48.520212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:48.529274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:48.530894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8757e-14e9-41d9-bece-673bb3702264 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:48.540830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 694/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:51.215079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816aa3-2feb-4fbe-b6bf-4413dc34e8a5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:51.215644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816aa3-2feb-4fbe-b6bf-4413dc34e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:51.215809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816aa3-2feb-4fbe-b6bf-4413dc34e8a5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:51.217191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 692/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:51.222739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea946-5bc1-48e1-90a1-77598fb99854 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:51.223164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea946-5bc1-48e1-90a1-77598fb99854 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:51.223306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea946-5bc1-48e1-90a1-77598fb99854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:51.244101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-94eea946-5bc1-48e1-90a1-77598fb99854 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:51.245578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-94eea946-5bc1-48e1-90a1-77598fb99854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:51.255244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 695/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:51.302297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816aa3-2feb-4fbe-b6bf-4413dc34e8a5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:51.317424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816aa3-2feb-4fbe-b6bf-4413dc34e8a5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:51.324061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:51.324926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:51.325280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:51.325635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:51.336524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:51.338542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c68735-6f87-4670-9fb8-94066e435130 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:51.350097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 693/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:54.163574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d51-5201-4afa-841f-52b51660f288 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:54.164296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d51-5201-4afa-841f-52b51660f288 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:54.164296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d51-5201-4afa-841f-52b51660f288 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:54.165468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 696/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:11:54.171126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552063-84e8-485e-85d9-42a9d64eedc6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:54.171673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552063-84e8-485e-85d9-42a9d64eedc6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:54.171861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552063-84e8-485e-85d9-42a9d64eedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:54.195441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dd552063-84e8-485e-85d9-42a9d64eedc6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:54.197267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dd552063-84e8-485e-85d9-42a9d64eedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:54.208043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 694/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:54.256298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612d51-5201-4afa-841f-52b51660f288 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:54.271385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612d51-5201-4afa-841f-52b51660f288 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:54.277091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:54.278012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:54.278313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:54.278587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:54.287076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:54.288775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c6f2f-87ca-4627-af52-ed0c8bf7b074 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:54.298650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 697/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:56.876978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4327-a87f-417a-85a1-7d09b30d2ae3 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:56.877579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4327-a87f-417a-85a1-7d09b30d2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:56.877579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4327-a87f-417a-85a1-7d09b30d2ae3 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:56.878894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 695/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:56.884772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba73d-10c3-48b5-88bd-f5b7e24cea27 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:56.885223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba73d-10c3-48b5-88bd-f5b7e24cea27 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:56.885327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba73d-10c3-48b5-88bd-f5b7e24cea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:56.903092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e7bba73d-10c3-48b5-88bd-f5b7e24cea27 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:56.904306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e7bba73d-10c3-48b5-88bd-f5b7e24cea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:56.911890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 698/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:56.956014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4327-a87f-417a-85a1-7d09b30d2ae3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:56.970776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4327-a87f-417a-85a1-7d09b30d2ae3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:56.976579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:56.977226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:56.977502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:56.977771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:56.985720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:56.987316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053a22-1970-4f71-9bb9-054a8fecf8a9 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:56.996703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 696/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:57.188225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed557ee-4356-46bf-aeb1-11b7195291f0 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:57.188584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed557ee-4356-46bf-aeb1-11b7195291f0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:57.188818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed557ee-4356-46bf-aeb1-11b7195291f0 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:57.190153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 699/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:57.196758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84ff4-3789-4577-867a-6953807c3c4f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:57.197134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84ff4-3789-4577-867a-6953807c3c4f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:57.197513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84ff4-3789-4577-867a-6953807c3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:57.217142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-65a84ff4-3789-4577-867a-6953807c3c4f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:57.218374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-65a84ff4-3789-4577-867a-6953807c3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:57.226542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 697/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:57.285304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e1fa-7501-47e2-ba4b-6a599aff43ce None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:57.285592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e1fa-7501-47e2-ba4b-6a599aff43ce None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:57.285873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e1fa-7501-47e2-ba4b-6a599aff43ce None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:57.287432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 700/1397] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 12 08:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:57.292667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995c38-2116-4a47-b393-983872491793 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:57.292959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995c38-2116-4a47-b393-983872491793 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:57.293237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995c38-2116-4a47-b393-983872491793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:57.345218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-68995c38-2116-4a47-b393-983872491793 None None] MFA Rules not processed for user `2cff946b0e734b1ab57587bab203d78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:57.346442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-68995c38-2116-4a47-b393-983872491793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:57.405687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 698/1398] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 12 08:11:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:57.413894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e1fa-7501-47e2-ba4b-6a599aff43ce None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:57.424680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e1fa-7501-47e2-ba4b-6a599aff43ce None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:57.428383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:57.429025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:57.429303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:57.429582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:57.439741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:57.441444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a331f2a-4e39-4760-8b46-fff8d6d5cb37 service glance] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:57.451466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 701/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:11:58.013834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629d97-9da1-4687-bec6-1f9f3b9f77a3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:58.014340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629d97-9da1-4687-bec6-1f9f3b9f77a3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:58.014452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629d97-9da1-4687-bec6-1f9f3b9f77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:58.062970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6b629d97-9da1-4687-bec6-1f9f3b9f77a3 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:58.064205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6b629d97-9da1-4687-bec6-1f9f3b9f77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:58.126246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 699/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:11:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:58.168444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2fa3-2c8a-4104-96c1-61f4b795619c None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:58.168889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2fa3-2c8a-4104-96c1-61f4b795619c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:58.169019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2fa3-2c8a-4104-96c1-61f4b795619c None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:58.170356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 702/1401] 10.222.0.23 () {54 vars in 942 bytes} [Tue Apr 12 08:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:58.176317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb842c-06f8-42f2-bb0e-ea341b7bac9a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:58.176613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb842c-06f8-42f2-bb0e-ea341b7bac9a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:58.176902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb842c-06f8-42f2-bb0e-ea341b7bac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:58.224886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3cfb842c-06f8-42f2-bb0e-ea341b7bac9a None None] MFA Rules not processed for user `a35f5b8f9e834adb8d67eb2b6fb4ec62`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:58.226156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3cfb842c-06f8-42f2-bb0e-ea341b7bac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:58.296633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 700/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Tue Apr 12 08:11:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:58.305671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2fa3-2c8a-4104-96c1-61f4b795619c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:58.319505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2fa3-2c8a-4104-96c1-61f4b795619c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:58.324382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:58.325016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:58.325299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:58.325577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:58.333516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:58.335119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13bf0-228b-498f-af39-a49280e427cb service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:58.343466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 703/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:11:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:11:59.465899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3451f3-ebf6-4da7-92dc-7db7fb01b503 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:59.466471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3451f3-ebf6-4da7-92dc-7db7fb01b503 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:59.466471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3451f3-ebf6-4da7-92dc-7db7fb01b503 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:59.468178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 701/1404] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:11:59.475303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8e71-890e-4599-b0b1-a7a3f637b7ba None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:59.476043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8e71-890e-4599-b0b1-a7a3f637b7ba None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:59.476328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8e71-890e-4599-b0b1-a7a3f637b7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:59.494934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-625f8e71-890e-4599-b0b1-a7a3f637b7ba None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:11:59.496367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-625f8e71-890e-4599-b0b1-a7a3f637b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:11:59.508265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 704/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:11:59.554320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3451f3-ebf6-4da7-92dc-7db7fb01b503 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:11:59.569445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3451f3-ebf6-4da7-92dc-7db7fb01b503 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:11:59.584442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:11:59.585459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:11:59.585840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:11:59.586214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:11:59.625289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:11:59.626899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d862f38-fe14-4559-a4a6-df776ce9d9f8 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:11:59.638871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 702/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:02.079166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6ff3-a354-4e2d-ac31-c90bdffce20a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:02.079739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6ff3-a354-4e2d-ac31-c90bdffce20a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:02.079739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6ff3-a354-4e2d-ac31-c90bdffce20a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:02.081223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 705/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:02.086842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927125dd-39f3-4b30-ab35-1e944c0731ac None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:02.087239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927125dd-39f3-4b30-ab35-1e944c0731ac None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:02.087403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927125dd-39f3-4b30-ab35-1e944c0731ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:02.107137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-927125dd-39f3-4b30-ab35-1e944c0731ac None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:02.107137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-927125dd-39f3-4b30-ab35-1e944c0731ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:02.117010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 703/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:02.162830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb6ff3-a354-4e2d-ac31-c90bdffce20a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:02.180872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb6ff3-a354-4e2d-ac31-c90bdffce20a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:02.190720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:02.191381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:02.191699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:02.191979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:02.201838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:02.203417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960726-af6f-4889-9b89-f2c87f5a786a service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:02.213857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 706/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:22.532010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8d16-eeb3-49a1-9570-c7626adfd6a1 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:22.532640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8d16-eeb3-49a1-9570-c7626adfd6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:22.532640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8d16-eeb3-49a1-9570-c7626adfd6a1 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:22.533935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 704/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue Apr 12 08:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:22.539577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d328ed-e797-41ad-a85d-c246529953dc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:22.540054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d328ed-e797-41ad-a85d-c246529953dc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:22.540161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d328ed-e797-41ad-a85d-c246529953dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:22.558237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-52d328ed-e797-41ad-a85d-c246529953dc None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:22.559409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-52d328ed-e797-41ad-a85d-c246529953dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:22.567753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 707/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Apr 12 08:12:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:22.582215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f9e-ac37-4b01-9f4e-dc101fc89083 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:22.582500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f9e-ac37-4b01-9f4e-dc101fc89083 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:22.582778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f9e-ac37-4b01-9f4e-dc101fc89083 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:22.584164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 705/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue Apr 12 08:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:22.588742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a97a-a975-4975-a68d-3e0f7f398f37 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:22.589117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a97a-a975-4975-a68d-3e0f7f398f37 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:22.589400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a97a-a975-4975-a68d-3e0f7f398f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:22.606941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4c60a97a-a975-4975-a68d-3e0f7f398f37 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:22.608132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4c60a97a-a975-4975-a68d-3e0f7f398f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:22.617493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 708/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Apr 12 08:12:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:12:25.344790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422dfda-e48a-41df-969c-a00164ab0565 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:25.345316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422dfda-e48a-41df-969c-a00164ab0565 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:25.345316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422dfda-e48a-41df-969c-a00164ab0565 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:25.346694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:25.351913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d69b-84c9-45d7-8eb4-2921935cbc4b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:25.352349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d69b-84c9-45d7-8eb4-2921935cbc4b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:25.352460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d69b-84c9-45d7-8eb4-2921935cbc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:25.369754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7db9d69b-84c9-45d7-8eb4-2921935cbc4b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:25.370939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7db9d69b-84c9-45d7-8eb4-2921935cbc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:25.378733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:25.421617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422dfda-e48a-41df-969c-a00164ab0565 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:25.435581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422dfda-e48a-41df-969c-a00164ab0565 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:25.440972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:25.441553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:25.441839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:25.442123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:25.450619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:25.452306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897a6fd-d3a4-4641-acbe-bc3326672650 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:25.462129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 707/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:26.796468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c45fa-d73f-493f-b649-9e21334ded09 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:26.797037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c45fa-d73f-493f-b649-9e21334ded09 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:26.797037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c45fa-d73f-493f-b649-9e21334ded09 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:26.798372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:26.803177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47d2b4-8300-4457-9f0d-47dd8cd6aa82 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:26.803633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47d2b4-8300-4457-9f0d-47dd8cd6aa82 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:26.803795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47d2b4-8300-4457-9f0d-47dd8cd6aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:26.822796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3a47d2b4-8300-4457-9f0d-47dd8cd6aa82 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:26.824012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3a47d2b4-8300-4457-9f0d-47dd8cd6aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:26.831611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:27.000645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c45fa-d73f-493f-b649-9e21334ded09 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:27.015250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c45fa-d73f-493f-b649-9e21334ded09 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:27.020570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:27.021823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:27.022107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:27.022385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:27.030530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:27.032151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2689-d31a-47bf-8bb4-de055433784e service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:27.041283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 711/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:28.341882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10386c6-23c9-488e-9a8a-5141f93b86a6 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:28.342410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10386c6-23c9-488e-9a8a-5141f93b86a6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:28.342410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10386c6-23c9-488e-9a8a-5141f93b86a6 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:28.344004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:28.348876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c6d9-3b34-4348-b475-bfa58b16b26b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:28.349278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c6d9-3b34-4348-b475-bfa58b16b26b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:28.349434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c6d9-3b34-4348-b475-bfa58b16b26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:28.367052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b5c6c6d9-3b34-4348-b475-bfa58b16b26b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:28.368266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b5c6c6d9-3b34-4348-b475-bfa58b16b26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:28.375931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:28.528384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10386c6-23c9-488e-9a8a-5141f93b86a6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:28.542131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10386c6-23c9-488e-9a8a-5141f93b86a6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:28.547480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:28.548121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:28.548400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:28.548673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:28.556477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:28.558054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083d1e5-677d-49fb-a5c7-e4ccc87d3653 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:28.567060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 710/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:29.894651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85988b4-8e58-435f-80b2-4c0973914a58 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:29.895171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85988b4-8e58-435f-80b2-4c0973914a58 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:29.895266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85988b4-8e58-435f-80b2-4c0973914a58 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:29.897317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:29.902208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c76a6-c75c-49d0-869e-3fac90f26c75 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:29.902897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c76a6-c75c-49d0-869e-3fac90f26c75 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:29.903009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c76a6-c75c-49d0-869e-3fac90f26c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:29.920435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-655c76a6-c75c-49d0-869e-3fac90f26c75 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:29.921625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-655c76a6-c75c-49d0-869e-3fac90f26c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:29.929326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:30.076247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85988b4-8e58-435f-80b2-4c0973914a58 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:30.090532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85988b4-8e58-435f-80b2-4c0973914a58 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:30.095765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:30.096384 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:30.096664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:30.096932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:30.104835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:30.109223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63c7a-409a-415f-9e7f-5230c6c714b9 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:30.121233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 714/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:31.420986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89721-f816-4ba1-a162-cc42c93d0e25 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:31.421542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89721-f816-4ba1-a162-cc42c93d0e25 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:31.421542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89721-f816-4ba1-a162-cc42c93d0e25 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:31.422916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:31.428538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9278b-2ac1-43a9-a9f3-70ae4a7cf7a8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:31.428961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9278b-2ac1-43a9-a9f3-70ae4a7cf7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:31.429097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9278b-2ac1-43a9-a9f3-70ae4a7cf7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:31.446450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-65e9278b-2ac1-43a9-a9f3-70ae4a7cf7a8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:31.447604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-65e9278b-2ac1-43a9-a9f3-70ae4a7cf7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:31.456046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:31.602867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa89721-f816-4ba1-a162-cc42c93d0e25 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:31.617220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa89721-f816-4ba1-a162-cc42c93d0e25 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:31.622483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:31.623105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:31.623381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:31.623684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:31.631440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:31.633034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278b9bc-4a5e-4dba-99a9-3e8857d17a33 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:31.641948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 713/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:32.969818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93bbc-79c0-409d-bee6-86f98e0fb3d9 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:32.970386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93bbc-79c0-409d-bee6-86f98e0fb3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:32.970386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93bbc-79c0-409d-bee6-86f98e0fb3d9 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:32.971650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:32.977040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444086d-c701-4a22-915e-4ce077a50312 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:32.977464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444086d-c701-4a22-915e-4ce077a50312 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:32.977591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444086d-c701-4a22-915e-4ce077a50312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:32.995415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0444086d-c701-4a22-915e-4ce077a50312 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:32.996609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0444086d-c701-4a22-915e-4ce077a50312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:33.004123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:33.155303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93bbc-79c0-409d-bee6-86f98e0fb3d9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:33.169661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93bbc-79c0-409d-bee6-86f98e0fb3d9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:33.174908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:33.175560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:33.175841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:33.179973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:33.185268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:33.187124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b29ef-e4fe-4932-ad6f-14b328f5d682 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:33.196222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 717/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:34.498070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1349-c995-4858-955c-2d1447297b1d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:34.498597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1349-c995-4858-955c-2d1447297b1d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:34.498597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1349-c995-4858-955c-2d1447297b1d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:34.500003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:34.505006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31957-2b9d-4267-8004-e47c33949d50 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:34.505712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31957-2b9d-4267-8004-e47c33949d50 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:34.505712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31957-2b9d-4267-8004-e47c33949d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:34.522870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-aed31957-2b9d-4267-8004-e47c33949d50 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:34.524088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-aed31957-2b9d-4267-8004-e47c33949d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:34.531976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:34.679241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf1349-c995-4858-955c-2d1447297b1d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:34.693184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf1349-c995-4858-955c-2d1447297b1d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:34.698469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:34.699099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:34.699382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:34.699686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:34.707438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:34.709541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c34bb0-f6a2-4bba-845f-90a6e1ec5d4b service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:34.718554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 716/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:36.041688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e9e-9eb8-498f-b672-2ae121e86d8e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:36.042263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e9e-9eb8-498f-b672-2ae121e86d8e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:36.042263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e9e-9eb8-498f-b672-2ae121e86d8e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:36.043605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:36.048702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0117-77fe-414a-b87c-533785a93947 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:36.049130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0117-77fe-414a-b87c-533785a93947 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:36.049256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0117-77fe-414a-b87c-533785a93947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:36.066624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-24cc0117-77fe-414a-b87c-533785a93947 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:36.068369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-24cc0117-77fe-414a-b87c-533785a93947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:36.076145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:36.222847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86e9e-9eb8-498f-b672-2ae121e86d8e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:36.236902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86e9e-9eb8-498f-b672-2ae121e86d8e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:36.242745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:36.243371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:36.243681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:36.243957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:36.251879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:36.253450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd805d2-41f8-4dd0-84be-c7d5937b3a54 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:36.263298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 720/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:37.561739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd3ec-b58e-49d4-b8ae-a63c6c044ddb None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:37.562269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd3ec-b58e-49d4-b8ae-a63c6c044ddb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:37.562269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfd3ec-b58e-49d4-b8ae-a63c6c044ddb None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:37.563683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:37.569207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960882b5-6eb0-4ab2-a450-9bba6e9fdcc3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:37.569634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960882b5-6eb0-4ab2-a450-9bba6e9fdcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:37.569755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960882b5-6eb0-4ab2-a450-9bba6e9fdcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:37.588273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-960882b5-6eb0-4ab2-a450-9bba6e9fdcc3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:37.589455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-960882b5-6eb0-4ab2-a450-9bba6e9fdcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:37.597027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:12:37.744070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfd3ec-b58e-49d4-b8ae-a63c6c044ddb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:37.758485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfd3ec-b58e-49d4-b8ae-a63c6c044ddb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:37.763803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:37.764430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:37.764715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:37.764991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:37.775486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:37.778510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c73c-a9ad-49f5-9842-caa97e32dc0a service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:37.788884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 719/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:39.957781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002febb8-6bd3-4e98-ba20-689732ed8bb1 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:39.958879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002febb8-6bd3-4e98-ba20-689732ed8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:39.958879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002febb8-6bd3-4e98-ba20-689732ed8bb1 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:39.960274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:39.965478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2fc4-79b1-45e3-b8a0-46aa36929d4c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:39.966210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2fc4-79b1-45e3-b8a0-46aa36929d4c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:39.966513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2fc4-79b1-45e3-b8a0-46aa36929d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:39.984293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-40ad2fc4-79b1-45e3-b8a0-46aa36929d4c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:39.985463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-40ad2fc4-79b1-45e3-b8a0-46aa36929d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:39.993143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:40.032287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002febb8-6bd3-4e98-ba20-689732ed8bb1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:40.043270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002febb8-6bd3-4e98-ba20-689732ed8bb1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:40.046722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:40.047346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:40.047660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:40.047933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:40.056534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:40.057938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905e77-43b9-4bf7-a249-8317ddee82d7 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:40.066997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 723/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:42.480432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b212e4-5190-4c95-b4e1-e5c1459bf44b None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:42.481000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b212e4-5190-4c95-b4e1-e5c1459bf44b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:42.481000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b212e4-5190-4c95-b4e1-e5c1459bf44b None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:42.482430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:42.487735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5216d4-74b4-48ab-b947-028b9ffa10f8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:42.488173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5216d4-74b4-48ab-b947-028b9ffa10f8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:42.488361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5216d4-74b4-48ab-b947-028b9ffa10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:42.506929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-df5216d4-74b4-48ab-b947-028b9ffa10f8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:42.508140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-df5216d4-74b4-48ab-b947-028b9ffa10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:42.516112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:42.555169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b212e4-5190-4c95-b4e1-e5c1459bf44b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:42.565647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b212e4-5190-4c95-b4e1-e5c1459bf44b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:42.569785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:42.570417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:42.570700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:42.570977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:42.579629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:42.585090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36277-1018-4456-99f5-d0ba35cd7df1 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:42.590159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 722/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:45.294458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecce79-4b14-4a00-a203-3667a7fed8f7 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:45.295005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecce79-4b14-4a00-a203-3667a7fed8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:45.295005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecce79-4b14-4a00-a203-3667a7fed8f7 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:45.296407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:45.302154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bff0a-6a24-4671-9fbc-0697fe385599 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:45.302569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bff0a-6a24-4671-9fbc-0697fe385599 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:45.302706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bff0a-6a24-4671-9fbc-0697fe385599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:45.320952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2b7bff0a-6a24-4671-9fbc-0697fe385599 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:45.322139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2b7bff0a-6a24-4671-9fbc-0697fe385599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:45.329893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:45.368744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecce79-4b14-4a00-a203-3667a7fed8f7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:45.379069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecce79-4b14-4a00-a203-3667a7fed8f7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:45.383208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:45.383873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:45.384155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:45.384429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:45.393034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:45.394454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597553b-f911-4d73-8205-3e5276fd85e4 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:45.403947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 726/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:47.789385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fa06-9f9c-4f14-8547-4fc0c16deb7d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:47.789896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fa06-9f9c-4f14-8547-4fc0c16deb7d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:47.789896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fa06-9f9c-4f14-8547-4fc0c16deb7d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:47.791236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:47.796325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015ec5-1324-4bbf-9ea6-a38195a296cf None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:47.796726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015ec5-1324-4bbf-9ea6-a38195a296cf None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:47.796865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015ec5-1324-4bbf-9ea6-a38195a296cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:47.814334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-73015ec5-1324-4bbf-9ea6-a38195a296cf None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:47.815529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-73015ec5-1324-4bbf-9ea6-a38195a296cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:47.824215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:47.870197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47fa06-9f9c-4f14-8547-4fc0c16deb7d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:47.880697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47fa06-9f9c-4f14-8547-4fc0c16deb7d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:47.884286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:47.884940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:47.885230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:47.885537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:47.897820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:47.899256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc483-4751-4577-99b9-f87a371966e1 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:47.908774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 725/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:50.225942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61884a5-9f7d-43be-b043-4a9fd3ce4d8e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:50.226409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61884a5-9f7d-43be-b043-4a9fd3ce4d8e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:50.226510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61884a5-9f7d-43be-b043-4a9fd3ce4d8e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:50.227879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:50.232956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c042-cd92-4bcd-91da-4e7ebb7d9a8e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:50.233386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c042-cd92-4bcd-91da-4e7ebb7d9a8e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:50.233497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c042-cd92-4bcd-91da-4e7ebb7d9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:50.251358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-25e0c042-cd92-4bcd-91da-4e7ebb7d9a8e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:50.252683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-25e0c042-cd92-4bcd-91da-4e7ebb7d9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:50.260236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:50.299234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61884a5-9f7d-43be-b043-4a9fd3ce4d8e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:50.310312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61884a5-9f7d-43be-b043-4a9fd3ce4d8e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:50.313790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:50.314414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:50.314693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:50.314966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:50.323558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:50.324967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514896-757f-44b7-8bbf-7aa576dbfed9 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:50.334014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 729/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:52.649926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:52.650447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:52.650575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:52.651876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:52.657201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00208c3-13c5-4a76-9f64-30641a3dfe9a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:52.657609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00208c3-13c5-4a76-9f64-30641a3dfe9a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:52.657752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00208c3-13c5-4a76-9f64-30641a3dfe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:52.675206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a00208c3-13c5-4a76-9f64-30641a3dfe9a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:52.677043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a00208c3-13c5-4a76-9f64-30641a3dfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:52.685615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:52.726285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:52.728155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:52.741538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5fa2a-8b73-4ba1-a4ae-425e6eff6049 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:52.745396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:52.746185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:52.746471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:52.746748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:52.756063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:52.757663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5809a6-12ea-4fc3-88be-40dc62bf1a20 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:52.767090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 728/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:55.117184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190e95-9301-490f-8349-6b06bb0d344b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:55.117723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190e95-9301-490f-8349-6b06bb0d344b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:55.117723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190e95-9301-490f-8349-6b06bb0d344b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:55.119092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:55.125374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057c09-6728-4331-8b16-ceabb8071bec None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:55.125813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057c09-6728-4331-8b16-ceabb8071bec None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:55.125933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057c09-6728-4331-8b16-ceabb8071bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:55.143766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e4057c09-6728-4331-8b16-ceabb8071bec None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:55.144950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e4057c09-6728-4331-8b16-ceabb8071bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:55.152824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:55.190367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190e95-9301-490f-8349-6b06bb0d344b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:55.201486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190e95-9301-490f-8349-6b06bb0d344b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:55.204916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:55.205541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:55.205817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:55.206086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:55.214622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:55.216080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc07634-7b32-4165-95da-2522d64c6835 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:55.225045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 732/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:12:57.687300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68682bb-b3fc-4aaa-af75-8cf0fcfee1d0 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:57.687863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68682bb-b3fc-4aaa-af75-8cf0fcfee1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:57.687863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68682bb-b3fc-4aaa-af75-8cf0fcfee1d0 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:57.689261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:12:57.694990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd538-c22e-4c48-b4e3-ee4e38aeb0af None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:57.695410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd538-c22e-4c48-b4e3-ee4e38aeb0af None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:57.695582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd538-c22e-4c48-b4e3-ee4e38aeb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:57.713163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-1a4bd538-c22e-4c48-b4e3-ee4e38aeb0af None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:12:57.714352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1a4bd538-c22e-4c48-b4e3-ee4e38aeb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:12:57.722099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:12:57.759805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68682bb-b3fc-4aaa-af75-8cf0fcfee1d0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:12:57.770782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68682bb-b3fc-4aaa-af75-8cf0fcfee1d0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:12:57.774320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:12:57.774959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:12:57.775247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:12:57.775552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:12:57.784463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:12:57.785950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9aaf78-8bda-492f-809b-44db67a228d6 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:12:57.795069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 731/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:00.094352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116921-e9a1-493c-bf35-e7f1acf28ea9 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:00.094894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116921-e9a1-493c-bf35-e7f1acf28ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:00.094894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116921-e9a1-493c-bf35-e7f1acf28ea9 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:00.096293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:00.102106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775e87-4863-4c1e-a330-f015965c31e4 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:00.102535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775e87-4863-4c1e-a330-f015965c31e4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:00.102661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775e87-4863-4c1e-a330-f015965c31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:00.121820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-98775e87-4863-4c1e-a330-f015965c31e4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:00.123025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-98775e87-4863-4c1e-a330-f015965c31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:00.130890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:00.172157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116921-e9a1-493c-bf35-e7f1acf28ea9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:00.183360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116921-e9a1-493c-bf35-e7f1acf28ea9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:00.186885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:00.187566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:00.187835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:00.188106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:00.197577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:00.199083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14902688-dde2-4c6e-a0a8-c335eca7514b service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:00.208836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 735/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:02.488990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41a52-d373-407f-bb3e-bf7091a7ce84 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:02.489537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41a52-d373-407f-bb3e-bf7091a7ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:02.489537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41a52-d373-407f-bb3e-bf7091a7ce84 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:02.491035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:02.496520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2674-0f97-4418-9494-6e3759f9c417 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:02.496952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2674-0f97-4418-9494-6e3759f9c417 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:02.497086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2674-0f97-4418-9494-6e3759f9c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:02.514744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-53fe2674-0f97-4418-9494-6e3759f9c417 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:02.515967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-53fe2674-0f97-4418-9494-6e3759f9c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:02.523808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:02.560861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f41a52-d373-407f-bb3e-bf7091a7ce84 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:02.572156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f41a52-d373-407f-bb3e-bf7091a7ce84 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:02.575645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:02.576281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:02.576567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:02.576848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:02.585531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:02.586956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d0b4-951f-4745-b297-134338cbf8c3 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:02.596224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 734/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:35.807885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29e13-2993-4807-8905-f2a3ff0d6f29 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:35.808450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29e13-2993-4807-8905-f2a3ff0d6f29 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:35.808450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29e13-2993-4807-8905-f2a3ff0d6f29 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:35.809781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 737/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:35.815466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805f4f-5272-4969-ab98-145eac36f4d4 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:35.815940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805f4f-5272-4969-ab98-145eac36f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:35.816040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805f4f-5272-4969-ab98-145eac36f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:35.833745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b0805f4f-5272-4969-ab98-145eac36f4d4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:35.834925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b0805f4f-5272-4969-ab98-145eac36f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:35.842589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 735/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:35.888043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec09bc-9275-43fa-8a9d-d5c255351f48 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:35.888363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec09bc-9275-43fa-8a9d-d5c255351f48 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:35.888640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec09bc-9275-43fa-8a9d-d5c255351f48 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:35.889972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 738/1473] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 12 08:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:35.895088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3102-8da5-4e9e-acf8-f3a54eee8649 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:35.895379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3102-8da5-4e9e-acf8-f3a54eee8649 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:35.895691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3102-8da5-4e9e-acf8-f3a54eee8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:35.913225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c99c3102-8da5-4e9e-acf8-f3a54eee8649 None None] MFA Rules not processed for user `2cff946b0e734b1ab57587bab203d78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:35.914421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c99c3102-8da5-4e9e-acf8-f3a54eee8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:35.920686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 736/1474] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 12 08:13:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:35.927459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec09bc-9275-43fa-8a9d-d5c255351f48 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:35.937831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec09bc-9275-43fa-8a9d-d5c255351f48 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:35.941847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:35.942462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:35.942747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:35.943025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:35.951735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:35.953152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7f44-a0e5-4236-ab3a-081af0d4fd7f service glance] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:35.962984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 739/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:13:38.332983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453bcd5-3e7a-4cc4-877a-4d7d3e5f8a05 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:38.333510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453bcd5-3e7a-4cc4-877a-4d7d3e5f8a05 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:38.333510 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453bcd5-3e7a-4cc4-877a-4d7d3e5f8a05 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:38.334930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 737/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:38.340324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2841-316e-4797-8a41-502a0a9d9c23 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:38.344286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2841-316e-4797-8a41-502a0a9d9c23 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:38.344286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2841-316e-4797-8a41-502a0a9d9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:38.358573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-586d2841-316e-4797-8a41-502a0a9d9c23 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:38.359814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-586d2841-316e-4797-8a41-502a0a9d9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:38.367944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 740/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:38.390768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453bcd5-3e7a-4cc4-877a-4d7d3e5f8a05 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:38.403126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453bcd5-3e7a-4cc4-877a-4d7d3e5f8a05 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:38.407545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:38.408716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:38.409000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:38.409274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:38.409999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:38.411715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:13:38.411715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:13:38.411715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:13:38.412835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78964f-3dd6-4963-883c-597eea0d0a7d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:38.431846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 738/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 12 08:13:38 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:13:40.738176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f32d6-3394-491d-bf0b-75475e5410c1 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:40.738736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f32d6-3394-491d-bf0b-75475e5410c1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:40.738736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f32d6-3394-491d-bf0b-75475e5410c1 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:40.740102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 741/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:40.745386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d66a-481c-4b74-a718-7a76ac6537ff None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:40.745771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d66a-481c-4b74-a718-7a76ac6537ff None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:40.745994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d66a-481c-4b74-a718-7a76ac6537ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:40.764876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4266d66a-481c-4b74-a718-7a76ac6537ff None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:40.766058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4266d66a-481c-4b74-a718-7a76ac6537ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:40.773769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 739/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:40.816378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f32d6-3394-491d-bf0b-75475e5410c1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:40.830282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f32d6-3394-491d-bf0b-75475e5410c1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:40.835590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:40.836220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:40.836502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:40.836775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:40.844594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:40.846159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ed25f-f0db-4e9e-8a3a-fd2219361f03 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:40.855513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 742/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:43.306547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869751c-6fe4-46d1-90d4-d16a8c6bacbf None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:43.307157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869751c-6fe4-46d1-90d4-d16a8c6bacbf None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:43.307157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869751c-6fe4-46d1-90d4-d16a8c6bacbf None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:43.308511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 740/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:43.313580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6f22-32a7-408c-ac1d-9f241712977e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:43.316116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6f22-32a7-408c-ac1d-9f241712977e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:43.316116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6f22-32a7-408c-ac1d-9f241712977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:43.332946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-92ec6f22-32a7-408c-ac1d-9f241712977e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:43.334137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-92ec6f22-32a7-408c-ac1d-9f241712977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:43.342560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 743/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:43.378719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869751c-6fe4-46d1-90d4-d16a8c6bacbf None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:43.389815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869751c-6fe4-46d1-90d4-d16a8c6bacbf None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:43.394062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:43.394688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:43.395079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:43.395353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:43.405079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:43.406567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1203-5495-4e92-93fa-63c700f08200 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:43.415971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 741/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:45.756348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c01a6-c190-4094-9f7c-10bb67851d23 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:45.756882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c01a6-c190-4094-9f7c-10bb67851d23 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:45.756882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c01a6-c190-4094-9f7c-10bb67851d23 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:45.758192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 744/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:45.763523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d147ce-e1c7-4eeb-9897-2ffc581e1146 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:45.763970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d147ce-e1c7-4eeb-9897-2ffc581e1146 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:45.764191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d147ce-e1c7-4eeb-9897-2ffc581e1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:45.781447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-07d147ce-e1c7-4eeb-9897-2ffc581e1146 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:45.782610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-07d147ce-e1c7-4eeb-9897-2ffc581e1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:45.790713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 742/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:45.828217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c01a6-c190-4094-9f7c-10bb67851d23 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:45.838589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c01a6-c190-4094-9f7c-10bb67851d23 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:45.842046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:45.842651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:45.842931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:45.843206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:45.852347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:45.853755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6340d-7c5a-495d-9167-6cd789285dce service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:45.863383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 745/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:48.269656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9ec0-e116-4a96-903d-f2dd727fd121 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:48.270175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9ec0-e116-4a96-903d-f2dd727fd121 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:48.270175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9ec0-e116-4a96-903d-f2dd727fd121 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:48.271586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 743/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:48.276667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e022d-af09-462d-a553-0a939927ca7d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:48.277106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e022d-af09-462d-a553-0a939927ca7d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:48.277211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e022d-af09-462d-a553-0a939927ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:48.294553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9b4e022d-af09-462d-a553-0a939927ca7d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:48.295789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9b4e022d-af09-462d-a553-0a939927ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:48.303987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 746/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:13:48.343443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9ec0-e116-4a96-903d-f2dd727fd121 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:48.353845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9ec0-e116-4a96-903d-f2dd727fd121 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:48.357277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:48.357904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:48.358181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:48.358453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:48.367994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:48.369423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e831-0cba-4b89-aa3f-4a32b5e8520f service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:48.379212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 744/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:13:51.004473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a7e0-2512-4cac-8547-69ec3aec424a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:51.005038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a7e0-2512-4cac-8547-69ec3aec424a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:51.005038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a7e0-2512-4cac-8547-69ec3aec424a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:51.006389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 747/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 12 08:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:13:51.011452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fcf-6967-438a-bef4-cb68fd2e2a46 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:51.011903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fcf-6967-438a-bef4-cb68fd2e2a46 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:51.012037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fcf-6967-438a-bef4-cb68fd2e2a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:51.029263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2e117fcf-6967-438a-bef4-cb68fd2e2a46 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:13:51.030431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2e117fcf-6967-438a-bef4-cb68fd2e2a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:13:51.038551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 745/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 12 08:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:13:51.076109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a7e0-2512-4cac-8547-69ec3aec424a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:13:51.086466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a7e0-2512-4cac-8547-69ec3aec424a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:13:51.089967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:13:51.090600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:13:51.090881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:13:51.091157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:13:51.100638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:13:51.102061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00644d-cbc3-4921-b9e4-49693e1ab2c5 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:13:51.111834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 748/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:15:49.803093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:49.803720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:49.803720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:49.831394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:15:49.831394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:49.833150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 746/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:15:49.843336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:49.843839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:49.843948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:49.861677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:15:49.862860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:49.870565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 749/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:15:49.875605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:49.884968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee7cf-428e-4cf3-a6c6-24fd1a819559 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:49.889440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:49.890079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:49.890354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:49.890623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:49.891339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:15:49.891673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:49.892680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:49.892680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:15:49.892680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:15:49.893547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:49.904919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 747/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:15:49.912620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:49.921910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6a6aa-f1c6-4bd1-97de-b847bcf227b1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:49.926401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:49.927042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:49.927324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:49.927632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:49.928319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:49.930057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:49.930057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:15:49.930057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:15:49.931264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.048882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 750/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:15:49 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:15:50.052732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.062711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07664e-24df-47fd-9e5a-cb35da3e52b4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.116802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.117427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.117711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.118041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.118764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.119799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:50.119799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:15:50.119799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:15:50.121045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.190942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 748/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:15:50 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:15:50.195037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.204965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797409e-6441-46d5-b7e9-0f773a7298d2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.209299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:15:50.214522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:15:50.215096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.225683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 751/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:15:50.229507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.239634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f007c-0988-4b2c-9a3e-a0dc5fba8fbe admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.244032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.244675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.244955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.245229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.245945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.246946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:50.246946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:15:50.246946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:15:50.247892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b1cd-d6d8-412a-b756-8d9f9a376737 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.260544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 749/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:15:50.264354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.273836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1333dd-73bd-4ba9-bd7a-761cd719e5ac admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.278494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.279933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.280210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.280503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] PATH_INFO: `/v3/projects/e77c9dc491ca4eac822191d63ac3ab9a/users/eb91107852c042c696b07b699d4a4cfd/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.294171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77c9dc491ca4eac822191d63ac3ab9a, user_id=eb91107852c042c696b07b699d4a4cfd, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.295803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:50.295803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:15:50.295803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:15:50.297694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.362647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 752/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:15:50 2022] PUT /identity/v3/projects/e77c9dc491ca4eac822191d63ac3ab9a/users/eb91107852c042c696b07b699d4a4cfd/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:15:50.373807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529957-f4b3-4f7a-9cfc-a92d9a7d9726 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.374037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529957-f4b3-4f7a-9cfc-a92d9a7d9726 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.374344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529957-f4b3-4f7a-9cfc-a92d9a7d9726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.399937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ef529957-f4b3-4f7a-9cfc-a92d9a7d9726 None None] MFA Rules not processed for user `eb91107852c042c696b07b699d4a4cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:15:50.401114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ef529957-f4b3-4f7a-9cfc-a92d9a7d9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:50.461090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 750/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:15:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:15:50.472802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.541262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9906-8730-438b-92fe-ea009d0b9b09 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.546744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.547380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.547689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.547967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.555528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.557150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.565779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 753/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:15:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:15:50.639508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b930-395e-4663-9cd4-5deda89e02fc None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.639804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b930-395e-4663-9cd4-5deda89e02fc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.640149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b930-395e-4663-9cd4-5deda89e02fc None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.641446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 751/1504] 10.222.0.23 () {52 vars in 829 bytes} [Tue Apr 12 08:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:15:50.644921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:50.703748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1711-a7e5-4bb3-9beb-cb93758fd2cd service nova] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:50.708226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:50.709064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:50.709346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:50.709612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] PATH_INFO: `/v3/users/eb91107852c042c696b07b699d4a4cfd` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:50.710794 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb91107852c042c696b07b699d4a4cfd)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:50.711817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:50.711817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:15:50.711817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:15:50.713001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:50.916608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb91107852c042c696b07b699d4a4cfd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:50.917284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb91107852c042c696b07b699d4a4cfd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:50.929155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb91107852c042c696b07b699d4a4cfd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:50.946395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb91107852c042c696b07b699d4a4cfd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.036545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb91107852c042c696b07b699d4a4cfd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.042919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 754/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:15:50 2022] DELETE /identity/v3/users/eb91107852c042c696b07b699d4a4cfd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:15:51.047319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:51.047813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:51.047925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:51.065576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:15:51.066774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:51.120965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 752/1506] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:15:51.130861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:51.132311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:51.188625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb4d1d-cd1b-4650-b06c-5d692e3a6691 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:51.192254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:51.192899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:51.193188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:51.193463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:51.202241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:51.203703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bafacb-0655-4087-ac0d-7cd9cd8383b3 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:51.212801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 755/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:15:51.701236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:15:51.702663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:15:51.714097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb899f-846f-49be-8d00-0f79b7a4c838 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:15:51.719227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:15:51.722563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:15:51.722563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:15:51.722563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] PATH_INFO: `/v3/projects/e77c9dc491ca4eac822191d63ac3ab9a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:15:51.726275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77c9dc491ca4eac822191d63ac3ab9a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:15:51.726275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:15:51.726275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:15:51.726275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:15:51.726275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:15:51.865810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77c9dc491ca4eac822191d63ac3ab9a', 'request_id': 'req-7f141259-7036-48b6-8627-d840518a9f05'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.871777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77c9dc491ca4eac822191d63ac3ab9a', 'request_id': 'req-7f141259-7036-48b6-8627-d840518a9f05'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.940046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77c9dc491ca4eac822191d63ac3ab9a', 'request_id': 'req-7f141259-7036-48b6-8627-d840518a9f05'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.958709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] The token cache is being invalidate because project e77c9dc491ca4eac822191d63ac3ab9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:15:51.958994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.959646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7f141259-7036-48b6-8627-d840518a9f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:15:51.961276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 753/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:15:51 2022] DELETE /identity/v3/projects/e77c9dc491ca4eac822191d63ac3ab9a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:17:28.493233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:28.493815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:28.493815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:28.495057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 756/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:28.500418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a92e-65ea-4084-9c5d-dd5a7b2e1e0f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:28.500832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a92e-65ea-4084-9c5d-dd5a7b2e1e0f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:28.500987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a92e-65ea-4084-9c5d-dd5a7b2e1e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:28.519214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1744a92e-65ea-4084-9c5d-dd5a7b2e1e0f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:28.520451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1744a92e-65ea-4084-9c5d-dd5a7b2e1e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:28.576471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 754/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:28.738409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:28.740137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:28.812412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0a31-49a2-484f-8900-8371bc2a01db None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:28.817528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:28.818163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:28.818444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:28.818718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:28.826564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:28.828168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91e83-aa4f-4547-8349-2fb99810f14b service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:28.837074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 757/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:29.446545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3e5-5fef-420a-9809-41a2d93ea65b None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:29.446747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3e5-5fef-420a-9809-41a2d93ea65b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:29.447016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3e5-5fef-420a-9809-41a2d93ea65b None None] PATH_INFO: `/v3` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:29.448361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 755/1512] 10.222.0.25 () {54 vars in 925 bytes} [Tue Apr 12 08:17:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:17:29.454315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e971f-ce37-4503-a0e1-ed82f769c7f8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:29.454611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e971f-ce37-4503-a0e1-ed82f769c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:29.454890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e971f-ce37-4503-a0e1-ed82f769c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:29.473660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-055e971f-ce37-4503-a0e1-ed82f769c7f8 None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:29.474868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-055e971f-ce37-4503-a0e1-ed82f769c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:29.536981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 758/1513] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Apr 12 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:30.128179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61b56-fba0-4526-b1a5-c5ff480ed53d None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:30.128672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61b56-fba0-4526-b1a5-c5ff480ed53d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:30.128784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61b56-fba0-4526-b1a5-c5ff480ed53d None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:30.130113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:30.135072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c635b-5e5c-49ad-9740-b153bab0ad69 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:30.135367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c635b-5e5c-49ad-9740-b153bab0ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:30.135686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c635b-5e5c-49ad-9740-b153bab0ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:30.156567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c24c635b-5e5c-49ad-9740-b153bab0ad69 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:30.157742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c24c635b-5e5c-49ad-9740-b153bab0ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:30.165489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:17:30.321235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61b56-fba0-4526-b1a5-c5ff480ed53d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:30.335811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61b56-fba0-4526-b1a5-c5ff480ed53d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:30.342386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:30.343016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:30.343300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:30.343614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:30.354262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:30.356224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec435-b150-4d23-843b-5bfa66b7cf42 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:30.365995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 757/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:33.784894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4553-909e-43d8-b1e3-fe1565ddcd55 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:33.785419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4553-909e-43d8-b1e3-fe1565ddcd55 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:33.785419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4553-909e-43d8-b1e3-fe1565ddcd55 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:33.786713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 760/1517] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:33.791585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379d64-98f0-45ab-b86c-b254b8dfca30 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:33.791981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379d64-98f0-45ab-b86c-b254b8dfca30 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:33.792171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379d64-98f0-45ab-b86c-b254b8dfca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:33.810916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5e379d64-98f0-45ab-b86c-b254b8dfca30 None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:33.812141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5e379d64-98f0-45ab-b86c-b254b8dfca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:33.820535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 758/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:17:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:33.827725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4553-909e-43d8-b1e3-fe1565ddcd55 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:33.840545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4553-909e-43d8-b1e3-fe1565ddcd55 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:33.845388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:33.846009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:33.846290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:33.846566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:33.854470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:33.856627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42026298-6a10-45bc-8c77-2e710c01aa79 service placement] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:33.865877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 761/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:42.043113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b59e-96c0-4897-aa8d-97cdd236e316 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:42.043706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b59e-96c0-4897-aa8d-97cdd236e316 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:42.043706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b59e-96c0-4897-aa8d-97cdd236e316 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:42.045061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 759/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:17:42.050121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4eb1-ac97-49f9-91b0-f4f0ecb7d318 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:42.050527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4eb1-ac97-49f9-91b0-f4f0ecb7d318 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:42.059340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4eb1-ac97-49f9-91b0-f4f0ecb7d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:42.068031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6f3e4eb1-ac97-49f9-91b0-f4f0ecb7d318 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:42.069253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6f3e4eb1-ac97-49f9-91b0-f4f0ecb7d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:42.077507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 762/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:42.226671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b59e-96c0-4897-aa8d-97cdd236e316 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:42.241010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b59e-96c0-4897-aa8d-97cdd236e316 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:42.246320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:42.246975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:42.247262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:42.247573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:42.255413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:42.257035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9684b9-8edf-4613-a112-aaae61e7a227 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:42.266960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 760/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:43.515457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b87b3-460f-41a4-9fc1-535787ad86be None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:43.516036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b87b3-460f-41a4-9fc1-535787ad86be None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:43.516036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b87b3-460f-41a4-9fc1-535787ad86be None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:43.517310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 763/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 08:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:43.522138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7473b3-5e1b-4276-98f1-b01ba0db6430 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:43.522604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7473b3-5e1b-4276-98f1-b01ba0db6430 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:43.522698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7473b3-5e1b-4276-98f1-b01ba0db6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:43.541317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1e7473b3-5e1b-4276-98f1-b01ba0db6430 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:43.542508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1e7473b3-5e1b-4276-98f1-b01ba0db6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:43.550464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 761/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 08:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:43.702641 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b87b3-460f-41a4-9fc1-535787ad86be None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:43.717225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b87b3-460f-41a4-9fc1-535787ad86be None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:43.722485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:43.723120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:43.723395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:43.723755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:43.731700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:43.733279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73a130-a763-488c-ad70-ce34fa9320a0 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:43.742472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 764/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:47.869206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:47.869778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:47.869778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:47.871142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 762/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:47.876254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7d9a-3b0f-4081-9782-efe9e3a35a89 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:47.876685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7d9a-3b0f-4081-9782-efe9e3a35a89 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:47.876809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7d9a-3b0f-4081-9782-efe9e3a35a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:47.900200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-577d7d9a-3b0f-4081-9782-efe9e3a35a89 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:47.900200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-577d7d9a-3b0f-4081-9782-efe9e3a35a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:47.903939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 765/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:47.939606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:47.941404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:47.999846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b1070-94b6-46a2-9d2c-47e589fdf9e5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:48.003341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:48.004025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:48.004307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:48.004581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:48.013724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:48.015144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bbabc-f6f0-4e21-8edb-3e3af8f3854e service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:48.024152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 763/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:50.270658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c95-78e9-4a20-b791-ef1d14389469 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:50.271226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c95-78e9-4a20-b791-ef1d14389469 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:50.271226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c95-78e9-4a20-b791-ef1d14389469 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:50.272608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 766/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:50.277890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed78b-6e1e-4a06-a54f-8fd8266c020f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:50.278335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed78b-6e1e-4a06-a54f-8fd8266c020f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:50.278466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed78b-6e1e-4a06-a54f-8fd8266c020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:50.296258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-646ed78b-6e1e-4a06-a54f-8fd8266c020f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:50.297418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-646ed78b-6e1e-4a06-a54f-8fd8266c020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:50.305043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 764/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:50.340850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15c95-78e9-4a20-b791-ef1d14389469 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:50.351305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15c95-78e9-4a20-b791-ef1d14389469 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:50.354802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:50.355435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:50.355753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:50.356026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:50.365057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:50.366489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74f9bb-d09e-4614-aed1-b37bbebea060 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:50.376204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 767/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:54.069420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:54.069949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:54.069949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:54.071255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 765/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:54.076520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfdb4-62c9-4d3e-bad0-9f3ceec6739c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:54.076933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfdb4-62c9-4d3e-bad0-9f3ceec6739c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:54.077085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfdb4-62c9-4d3e-bad0-9f3ceec6739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:54.094853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-604cfdb4-62c9-4d3e-bad0-9f3ceec6739c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:54.096120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-604cfdb4-62c9-4d3e-bad0-9f3ceec6739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:54.104061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 768/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:54.377298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:54.378939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:54.434552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00e67-b3a0-4f93-bf30-9095561b4799 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:54.438118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:54.438762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:54.439045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:54.439318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:54.447902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:54.449330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de11d4-1c1c-415e-b47a-1b1fd4dd2e5d service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:54.459015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 766/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:17:56.775387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baffc49-55ce-4947-8b9f-95567a6a5ae6 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:56.776022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baffc49-55ce-4947-8b9f-95567a6a5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:56.776117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baffc49-55ce-4947-8b9f-95567a6a5ae6 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:56.777734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 769/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:56.782880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d807d0-d228-498c-a026-3c705d89d6d6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:56.783319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d807d0-d228-498c-a026-3c705d89d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:56.783427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d807d0-d228-498c-a026-3c705d89d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:56.800819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-23d807d0-d228-498c-a026-3c705d89d6d6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:56.801991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-23d807d0-d228-498c-a026-3c705d89d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:56.810019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 767/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 08:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:57.079351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16149-d139-465f-822c-d774f69027f5 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:57.079673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16149-d139-465f-822c-d774f69027f5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:57.079957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16149-d139-465f-822c-d774f69027f5 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:57.081682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 770/1537] 10.222.0.23 () {54 vars in 962 bytes} [Tue Apr 12 08:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:17:57.087115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a3e4-4cb9-40f2-8b7a-f9aa117b8e67 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:57.087404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a3e4-4cb9-40f2-8b7a-f9aa117b8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:57.087711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a3e4-4cb9-40f2-8b7a-f9aa117b8e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:57.105035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7988a3e4-4cb9-40f2-8b7a-f9aa117b8e67 None None] MFA Rules not processed for user `b877e3bebb09444381fdee3fdbe4be24`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:17:57.106724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7988a3e4-4cb9-40f2-8b7a-f9aa117b8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:17:57.113037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 768/1538] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Apr 12 08:17:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:17:57.120316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16149-d139-465f-822c-d774f69027f5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:17:57.131310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16149-d139-465f-822c-d774f69027f5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:17:57.134789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:17:57.135413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:17:57.135728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:17:57.136006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:17:57.144682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:17:57.146102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c82c6a-89be-4ba4-aa62-e64783c631b2 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:17:57.155633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 771/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:25.797340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:25.797976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:25.797976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:25.821223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:25.822458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:25.839386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 769/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:25.851340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:25.851980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:25.851980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:25.880808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:25.882376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:25.896547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 772/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:25.902108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:25.916372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c43d4a-f7b6-4af8-86e5-91fe8e83cad3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:25.924204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:25.924896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:25.925185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:25.925467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:25.926215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:25.926694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:25.928246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:25.953277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 770/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:25.957487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:25.973762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584848-25e2-4c36-9ac0-74ac4f202d31 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:25.979101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:25.980050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:25.980584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:25.981068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:25.981980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:25.984257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0665e-aad2-4c0a-a4af-3f8bfc0261a4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.104474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 773/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:25 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:26.108316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.115409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36d38-8b55-41dc-8458-fa4df142e2dd None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.116182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36d38-8b55-41dc-8458-fa4df142e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.116852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36d38-8b55-41dc-8458-fa4df142e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.126295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760e3d-52fe-4eda-b9d3-e1fa4367dcb9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.144007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4ae36d38-8b55-41dc-8458-fa4df142e2dd None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.146306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4ae36d38-8b55-41dc-8458-fa4df142e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.254133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 774/1544] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.256424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cac6a-e78f-4e3f-a80a-964a26be0955 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.257014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cac6a-e78f-4e3f-a80a-964a26be0955 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.257525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cac6a-e78f-4e3f-a80a-964a26be0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.302954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e72cac6a-e78f-4e3f-a80a-964a26be0955 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.304064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.304231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e72cac6a-e78f-4e3f-a80a-964a26be0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.305330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.305660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.305892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.306605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.308800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe1f56-9b2f-4685-bfcd-faf087aa2a56 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.341971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 775/1545] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.343374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb94c2-ff13-4db6-95d1-7250ffff0efa None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.343588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb94c2-ff13-4db6-95d1-7250ffff0efa None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.343829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb94c2-ff13-4db6-95d1-7250ffff0efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.365486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-33bb94c2-ff13-4db6-95d1-7250ffff0efa None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.367158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-33bb94c2-ff13-4db6-95d1-7250ffff0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.376277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 776/1546] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.377944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfe76-2bf9-4159-8b93-7bb648f29d4a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.378500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfe76-2bf9-4159-8b93-7bb648f29d4a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.378979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfe76-2bf9-4159-8b93-7bb648f29d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.400351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8b2bfe76-2bf9-4159-8b93-7bb648f29d4a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.405834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8b2bfe76-2bf9-4159-8b93-7bb648f29d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.405950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 771/1547] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:26.406035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.406363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.406762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.412862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 777/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.414574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529a50-9b6b-4255-a87b-d08bd792eb87 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.415452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529a50-9b6b-4255-a87b-d08bd792eb87 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.415964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529a50-9b6b-4255-a87b-d08bd792eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.427728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.428941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.434723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-46529a50-9b6b-4255-a87b-d08bd792eb87 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.436170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-46529a50-9b6b-4255-a87b-d08bd792eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.437563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 772/1549] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.438185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.451814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 778/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.453712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadfba-fc56-4d4a-9a18-7e96a4745e39 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.454231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadfba-fc56-4d4a-9a18-7e96a4745e39 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.454842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadfba-fc56-4d4a-9a18-7e96a4745e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.458289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cb09-f09a-4d7c-9e56-486e686ae28b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.464057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.464729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.465016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.465293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.466028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.466335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.467976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.474318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-dcdadfba-fc56-4d4a-9a18-7e96a4745e39 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.475803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dcdadfba-fc56-4d4a-9a18-7e96a4745e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.481183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 773/1551] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.482007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.486067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 779/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.488872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053093f9-4fd1-4b0c-a1f7-f8de37fdedc5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.489236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053093f9-4fd1-4b0c-a1f7-f8de37fdedc5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.489525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053093f9-4fd1-4b0c-a1f7-f8de37fdedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.499642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470061-025a-4e50-8c3c-67a341ea235c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.504378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.504977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.505260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.505539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.506272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.507546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-053093f9-4fd1-4b0c-a1f7-f8de37fdedc5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.508456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a187b8a-da48-42e4-b89d-ad879881e7ec admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.509351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-053093f9-4fd1-4b0c-a1f7-f8de37fdedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.517380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 780/1553] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.521520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ad75-cba1-4772-a9f6-abdaaae2bf3b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.521665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 774/1554] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:26.521759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ad75-cba1-4772-a9f6-abdaaae2bf3b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.521759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ad75-cba1-4772-a9f6-abdaaae2bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.521899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.521899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.521899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.541328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.541675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8f72ad75-cba1-4772-a9f6-abdaaae2bf3b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.542546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.542935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8f72ad75-cba1-4772-a9f6-abdaaae2bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.551942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 775/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.552756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.554959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 781/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.559087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.559087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.559087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.563247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e10703-42dd-4836-98c0-7705a191a36d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.568205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.568863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.569142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.569616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.570861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.571166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.572799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35150dbe-f00e-4d76-a33f-684d6a60a113 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.576392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.577582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.585355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 782/1558] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.585622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 776/1558] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.586665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.588716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.589207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.589685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.595768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d676-c93d-4364-96f9-b6e463eaa202 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.600505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.601154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.601468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.601747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.602488 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.604669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.614402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.615613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.624317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 777/1559] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.625099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.634441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dd6c9-4502-4368-a033-9b82a29efb8f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.640420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.640420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.640420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.640420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.640796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.642255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccbb6-1b75-4913-9c5e-4fe52a8ef129 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.651605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 778/1560] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:26.653131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.653417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.653689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.670174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.671313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.678987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 779/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.680282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.689143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 783/1562] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:26.689911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.691330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77069415-b95d-4cb1-93ce-a2cabdeebb74 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.746252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.746943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.747228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.747538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.748267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.748412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693496-fe59-4539-a667-9f3ae94392b6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.748607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.750192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.752802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.753443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.753726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.753998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.754763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.755016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.756047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:26.756047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:19:26.756047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:19:26.756917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff31972-97e9-4e23-a92e-4f9d16f8393d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.762178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 780/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.764371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.775459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 784/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.775459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.775459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.775459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.775926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca9acb-aafe-472c-8cd3-5b117df94dbc admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.780247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.780892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.781176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.781450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.782165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.783192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:26.783192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:19:26.783192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:19:26.784427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.788048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:26.789266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:26.797179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 785/1565] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:26.797953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.807840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90862-06cd-4d1f-b6b8-258c4833539f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.812416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.813048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.813327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.813597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.814307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.814625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.816228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.827846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 786/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.828580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.837912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a11f-9ce0-43af-b258-d8162d800abe admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.842403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.843235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.843537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.843815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] PATH_INFO: `/v3/projects/06a4436df3ad431ea8a69e4d1a53c216/users/4c69d1709721460eb77784d0f468c9ec/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.857872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 781/1567] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:26.857872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.859119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a4436df3ad431ea8a69e4d1a53c216, user_id=4c69d1709721460eb77784d0f468c9ec, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.861807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.916487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec329b8a-c435-4987-ae84-e2b7683de5d5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.921242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.922065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.922216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:26.922485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:26.923196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:26.923529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:26.925137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:26.929070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 787/1568] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:26 2022] PUT /identity/v3/projects/06a4436df3ad431ea8a69e4d1a53c216/users/4c69d1709721460eb77784d0f468c9ec/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:26.930118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.938932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 782/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:26.938932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:26.948497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7472b-6d92-4762-93a9-452f94242a41 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.994272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13911ed-68e3-425a-bd7d-f17a83afd0db admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:26.998772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:26.999429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:26.999737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.000009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.000687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.001685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:27.001685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:19:27.001685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:19:27.002180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.002836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.002953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.003121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.003399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.004112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.006070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.119513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 788/1570] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.119513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.126974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9521d5-83cf-401e-ba39-2b63afb10a90 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.131405 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.132134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.132419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.132700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.133365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.135351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.164380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 783/1571] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:26 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.165431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.224106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 789/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.224106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.230037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae6e8-7e86-4657-849f-ff1b05f9916d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.281265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6f162-f8ab-4a24-9993-9f27db886ccd admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.283092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.283786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.284073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.284339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.285058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:27.285357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.286318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.287031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.287137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.287554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.287899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.288656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.291060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19331d5-8cc3-4356-93d8-c3d49814caea admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.298440 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 784/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:27.299215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.308787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6625375-3457-4843-b369-5a8ac4528fb6 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.313254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.315769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.315769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.315769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.315769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.316963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.404340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 790/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.405650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.405936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.406211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.424882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:27.431503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:27.431634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 785/1575] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.432133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.441384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c3c4-9f8e-4a01-bc06-779c9bc160fd admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.483743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 791/1576] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:27.484583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.493624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b86cb7-3087-4da2-8a7b-933d6bbc6a8e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.497929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.498091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.498602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.498724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.498943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.499055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.499263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.500014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.501364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.501613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.502080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.504015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.511198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 792/1577] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:27.512006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.520871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515b84-02cc-4436-8123-96cb8d831b22 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.526014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.531495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.531495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.531495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.531495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.531495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.631998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 786/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.633035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.645378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 793/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.646255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.656244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6410b-b06e-4903-b9f4-20402de8624b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.691686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037db3-2272-4240-b0fb-104b5ce481b1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.696785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.697463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.697876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.698161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.698851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.700812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.713085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.713748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.714031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.714311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.715000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.716971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.819640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 787/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.821078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.830522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbed0e-57e6-417a-872a-d9d061d78427 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.834937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 794/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.834937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.887919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.888594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.888882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.889156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.889863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.891805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.897006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7c625-c35e-4a8f-bd44-b0df9f909eb2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.902548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.903212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.903523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.903823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.904548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.906144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.915756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 795/1582] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:27.916597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.968371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d9a8-9041-497c-bf34-78cda349a280 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.971976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.972634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.972922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.973198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.982350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 788/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:27.982350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.982607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.983784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:27.989261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484a5f-5d3d-4ec9-9d77-99277d7dfd79 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:27.998415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 796/1584] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:27.998575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:27.998697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:27.998799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:27.998799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:27.998799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:27.998799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:27.998799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.004162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89596a7-64de-4ed3-86c0-ecd601eb0e85 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.008427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 789/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.009217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.010771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.011672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.013962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.013962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.013962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.015113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.021472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5038dd-a56c-48ac-9ff4-bfee5b45f7ad admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.027124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.027800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.028080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.028351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.029099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.030705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.041321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 790/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.041321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.051288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ae1-34e7-477e-bb9b-b0ce781b623e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.056039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.056665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.056944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.057218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.058004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.059569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.069279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 791/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.070047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.079507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90fde1-dc3f-4da9-ac91-e4dc342372e2 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.084322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.086511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.086511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.086511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.086968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.088906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.111266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 797/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:27 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:28.112270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.122821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360de74-1785-4a0a-ab04-3a58047d7e1c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.127612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.128267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.128555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.128835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.129590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.131186 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.142652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 798/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.143412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.153744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba25b-fd3f-4951-a1b7-bf93c6f7c22e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.158690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 792/1590] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:28 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:28.158981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.162337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.163022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.163309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.163610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.164341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.165997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.170853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f3d58-91da-40ca-ad69-3f2c7012f442 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.175896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.176992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.177275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.177551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] PATH_INFO: `/v3/projects/7411cb7c422c426da8dcf9ba38515373/users/88c132a4d80d40cd810b5d5b0eeda77e/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.183996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 799/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.184876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.196918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7411cb7c422c426da8dcf9ba38515373, user_id=88c132a4d80d40cd810b5d5b0eeda77e, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.197953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:28.197953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:19:28.197953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:19:28.199969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.201916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242d8d-8971-48ee-a92e-84bbd69446bc admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.206570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.207274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.207596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.207871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.208591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.210175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.220368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 800/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.221661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.230511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cffe4-eeb5-4c34-9e15-a49840cd01de admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.234942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.235586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.235971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.236250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.236942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.238486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.248726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 801/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.253281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.260746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3d47-a6ad-4171-b5bf-c942394e894e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.265292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.265938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.266216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.266489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.267320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.268930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.279162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 793/1594] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/7411cb7c422c426da8dcf9ba38515373/users/88c132a4d80d40cd810b5d5b0eeda77e/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:28.284172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 802/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.284172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.284393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.295861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124164ed-e7e6-402c-a3cc-41283ed04a13 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.356353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.357520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.357520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.357707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37169d-225a-4a5a-b514-a3dd1b67df84 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.357796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.358620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.360337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.362592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.363789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.364136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.364477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] PATH_INFO: `/v3/projects/c5df5bdc6238443fb11973f52caf4c09/users/ad2204eb50114552898320fcdb5577d9/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.371750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 803/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.374353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.382408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e579bb-7254-4e75-9254-25aff8970c74 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.383592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5df5bdc6238443fb11973f52caf4c09, user_id=ad2204eb50114552898320fcdb5577d9, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.386251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.387558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.388246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.388525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.388802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.389507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.391072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.400645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 804/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.401537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.411243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f768-0268-4fa2-a991-e3e358dafa86 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.416481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.417359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.420422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.420422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] PATH_INFO: `/v3/projects/533640587642423aa4e0053ba31626e1/users/f0510819592c416da20562e641a7ed0a/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.433314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533640587642423aa4e0053ba31626e1, user_id=f0510819592c416da20562e641a7ed0a, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.436065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b344b-1632-42f8-a613-576a1ebd5969 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.454111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 794/1598] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/c5df5bdc6238443fb11973f52caf4c09/users/ad2204eb50114552898320fcdb5577d9/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:28.454923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.518480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 805/1599] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/533640587642423aa4e0053ba31626e1/users/f0510819592c416da20562e641a7ed0a/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:28.521071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.521644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.522381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.529842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cc0e-7d38-4ae7-9320-3b586b7850e5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.546492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:28.547984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:28.594502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.595297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.595615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.595889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] PATH_INFO: `/v3/projects/8859054dce104e4f92d446e603343ffc/users/f9e2a76beab7414ebfc18ae310b44ee7/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.609220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 806/1600] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:28.612870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8859054dce104e4f92d446e603343ffc, user_id=f9e2a76beab7414ebfc18ae310b44ee7, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.615749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6910644-7879-48ff-a9df-a88654e3086e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.621403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.630851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761229-d035-42d6-be1a-5eedda41754d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.635519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.636184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.636466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.636746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.637463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.639062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.648789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 807/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.649658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.659527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fbf88-924b-40e9-ab29-b1632095cb65 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.664684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.665677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.665677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.665921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.666544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.668150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.677802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 808/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:28.678666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.684215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 795/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/8859054dce104e4f92d446e603343ffc/users/f9e2a76beab7414ebfc18ae310b44ee7/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:28.688187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de5b83-bc77-45e0-ae41-266b0ff496fa None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.688187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de5b83-bc77-45e0-ae41-266b0ff496fa None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.688187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de5b83-bc77-45e0-ae41-266b0ff496fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.689476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4394b-4e0d-44da-8752-c174f32bd5da admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.704275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-25de5b83-bc77-45e0-ae41-266b0ff496fa None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:28.705734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-25de5b83-bc77-45e0-ae41-266b0ff496fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:28.747126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.748047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.748331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.748599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] PATH_INFO: `/v3/projects/dc8d333bbf1b4e438b6db5ca7092b582/users/8c4029d4def64dc1b3c286400be2ab5c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.762491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8d333bbf1b4e438b6db5ca7092b582, user_id=8c4029d4def64dc1b3c286400be2ab5c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.765179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.765417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 796/1604] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:28.768691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.768691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.768691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.785619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:28.786828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:28.795436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 797/1605] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:28.796342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.797585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:28.854371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 809/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/dc8d333bbf1b4e438b6db5ca7092b582/users/8c4029d4def64dc1b3c286400be2ab5c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:28.855088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.857618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554f019-411b-413a-9fa6-63d75ada5a58 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.904719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.905380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.905682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.905901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.918343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebf8fd-953c-4b97-93a3-3e32dfff5042 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.923353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.924292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.924571 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.924870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] PATH_INFO: `/v3/projects/e8a7eb9cd0a5419ea69d5078791ea4b2/users/c85d792a3c7f41c785fb2fe0080878ea/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:28.939949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a7eb9cd0a5419ea69d5078791ea4b2, user_id=c85d792a3c7f41c785fb2fe0080878ea, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.942628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41ce23-2ca7-4f81-b29f-5a5708e2385f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.963991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:28.965451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:28.979677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 798/1607] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:28.980850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:28.991500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5aa3-ea43-459f-9312-43e890469305 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:28.996825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:28.997819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:28.998093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:28.998364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] PATH_INFO: `/v3/projects/8c06f066036c40d398859d28921ddbe5/users/28cdd27e0b5c4f7b9a1829ae7a29ed77/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.013121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c06f066036c40d398859d28921ddbe5, user_id=28cdd27e0b5c4f7b9a1829ae7a29ed77, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.015774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.036474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 810/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/e8a7eb9cd0a5419ea69d5078791ea4b2/users/c85d792a3c7f41c785fb2fe0080878ea/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:29.037979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.038557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.039589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.072442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] MFA Rules not processed for user `f9e2a76beab7414ebfc18ae310b44ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:29.073675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:29.115652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 799/1609] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:28 2022] PUT /identity/v3/projects/8c06f066036c40d398859d28921ddbe5/users/28cdd27e0b5c4f7b9a1829ae7a29ed77/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:29.117062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.142886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 811/1610] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:29.143652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.180629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f343-893e-4f6c-96ca-82a4993aa2b0 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.190883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.191675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.192204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.192585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.238591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad776-06fe-4abf-ae73-0bb8d35d317c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.246988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.247966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.248552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.249824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.281807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.283512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076be7-2707-4325-bb50-6a3c11ef477b service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.294730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 800/1611] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:29.296266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192b31-4616-43de-b98c-7d5c9fc0bc10 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.296689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192b31-4616-43de-b98c-7d5c9fc0bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.297617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192b31-4616-43de-b98c-7d5c9fc0bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.315915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f0192b31-4616-43de-b98c-7d5c9fc0bc10 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:29.317587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f0192b31-4616-43de-b98c-7d5c9fc0bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:29.327374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 801/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:29.328872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.329267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.329755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.357960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] MFA Rules not processed for user `c85d792a3c7f41c785fb2fe0080878ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:29.358773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.359463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:29.360849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b775f-0a6a-4c50-9d71-607dd29e3a7b service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.378080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 812/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:29.378080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.378080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.378080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.418951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] MFA Rules not processed for user `28cdd27e0b5c4f7b9a1829ae7a29ed77`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:29.420602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:29.432877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 802/1614] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:29.433888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.444596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529f44-7a00-44e2-9dd3-0765730ad24c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.458569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.459297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.459612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.459886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.460586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.463162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.553476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 803/1615] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:29.556822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.584420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 813/1616] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:29.585176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.641505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae473-7158-4c81-bf6a-44d2493651da admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.646543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.646543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.646543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.646901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.698110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8c2a3-c9fe-4525-a369-7469c63108b3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.727336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.728881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.747069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 804/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:29.747957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.758358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756e75-0b8b-4885-81c9-d5f02b053ad4 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.764138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.764681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.765022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.765303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.765999 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.768074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.777927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.784452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.786647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.786647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.854781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 805/1618] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:29.858394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.881444 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.881604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.882012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712978-7cd3-4668-8249-31ac290d0bae admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.898628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.898628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.898628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.898628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.899041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.899844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.913417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 814/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:29.916390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:29.954189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e96a0-4190-451d-b8c4-1001dd87a609 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:29.971505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:29.974417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:29.974798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:29.979716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:29.980573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:29.990027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:29.997659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 806/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:29 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:30.001561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.017574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 815/1621] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:30.037144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.070751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a5fe4-317b-4c4a-8154-a28010842df6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.117887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc97248-7223-41e5-8699-4035879173f3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.196060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.196060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.196060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.196060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.204412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.204412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.244637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.245159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.245377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.246375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] PATH_INFO: `/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5/users/5b33446c7909470fac6bcbcc4ac6ba10/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.279996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644bdb31a9b04776b1cd0efe7b65daa5, user_id=5b33446c7909470fac6bcbcc4ac6ba10, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.282656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.315888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 807/1622] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:30 2022] POST /identity/v3/users => generated 291 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:19:30.321201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.342818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ba5d-4d00-40d3-993c-0646521658e7 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.350977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.364226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.364663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.364946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.365747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.368157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.380809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 816/1623] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:30 2022] PUT /identity/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5/users/5b33446c7909470fac6bcbcc4ac6ba10/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:30.390380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.399758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 808/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:19:30.401703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.416643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15dc3c-57a1-4ea2-b6fd-d3ed157d671d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.479107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6efb0-1784-4134-94a4-afa0b3a568e1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.488547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.493459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.493459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.493459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.493459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.494041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.519570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.522445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.522445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.522445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] PATH_INFO: `/v3/projects/bda4130a20e6461d854e32a7cc08f967/users/79f26cd360144dbc9fdabaae4bebe164/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.533424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 817/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:19:30.535335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.565230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff26a2-5275-4c99-9ab6-db24c039ac63 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.569814 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda4130a20e6461d854e32a7cc08f967, user_id=79f26cd360144dbc9fdabaae4bebe164, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.571450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.573744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.573744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.573744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] PATH_INFO: `/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5/users/5b33446c7909470fac6bcbcc4ac6ba10/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.576128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=644bdb31a9b04776b1cd0efe7b65daa5, user_id=5b33446c7909470fac6bcbcc4ac6ba10, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.579183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbee67-218b-4c62-abf9-6d243eadf93e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.587866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.597025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 818/1626] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:30 2022] PUT /identity/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5/users/5b33446c7909470fac6bcbcc4ac6ba10/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:30.608931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.609224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.609500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.668241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] MFA Rules not processed for user `5b33446c7909470fac6bcbcc4ac6ba10`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:30.670153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:30.741847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 809/1627] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:30 2022] PUT /identity/v3/projects/bda4130a20e6461d854e32a7cc08f967/users/79f26cd360144dbc9fdabaae4bebe164/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:30.745689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.771251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 819/1628] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:30.785108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.900221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de623-f259-45f5-9ff5-5bc7bb98a529 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.910872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.911602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.911888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.912162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.914293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.915591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0236437-c44e-45f1-a772-ea0b5e6023a2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.917705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:30.944548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 810/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:30.946788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:30.970336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010174b-938d-4b57-8fb6-a64c6c998942 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:30.975984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:30.977297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:30.977678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:30.978186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] PATH_INFO: `/v3/projects/bda4130a20e6461d854e32a7cc08f967/users/79f26cd360144dbc9fdabaae4bebe164/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:30.981128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda4130a20e6461d854e32a7cc08f967, user_id=79f26cd360144dbc9fdabaae4bebe164, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:30.988453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e71d09-616d-423d-8f72-7d82d32f348c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:31.005784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:31.007069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:31.008109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:31.008908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:31.029393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 811/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:30 2022] PUT /identity/v3/projects/bda4130a20e6461d854e32a7cc08f967/users/79f26cd360144dbc9fdabaae4bebe164/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:31.031523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:31.032159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:31.032426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:31.083929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] MFA Rules not processed for user `79f26cd360144dbc9fdabaae4bebe164`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:31.085238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:31.163422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:31.168442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a042c-8121-421e-b59a-443185517e39 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:31.204594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 812/1631] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:31.214211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 820/1632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:31.228514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:31.327930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90899d-f5a5-45f6-a30f-b15a3eecca09 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:31.332433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:31.347111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:31.347111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:31.347111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:31.368327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:31.369858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054aa5-a831-4857-8714-3e7ebea3f4e1 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:31.398882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 813/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:32.658738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:32.659298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:32.659298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:32.715078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f639-6662-42d2-8042-6cfcf1379555 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:32.716087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f639-6662-42d2-8042-6cfcf1379555 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:32.716383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f639-6662-42d2-8042-6cfcf1379555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:32.728079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] MFA Rules not processed for user `8c4029d4def64dc1b3c286400be2ab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:32.728079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:32.776117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a978f639-6662-42d2-8042-6cfcf1379555 None None] MFA Rules not processed for user `f0510819592c416da20562e641a7ed0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:32.778066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a978f639-6662-42d2-8042-6cfcf1379555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:32.861274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 821/1634] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:32.862482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.006413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 814/1635] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:33.009725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.012718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.013240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.050854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] MFA Rules not processed for user `8c4029d4def64dc1b3c286400be2ab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:33.052855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.068907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 815/1636] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:33.071072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73db8-f64b-4679-ab98-9b0ab0e3d39d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:33.072049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.082491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:33.085046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.086165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.087385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] PATH_INFO: `/v3/users/f9e2a76beab7414ebfc18ae310b44ee7` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.090139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e2a76beab7414ebfc18ae310b44ee7)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:33.096741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:33.097942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702456-cf40-492f-aecc-70066bc55b4c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:33.107002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:33.108602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.110411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.110806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.114541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:33.142711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62944dd4-3227-4906-9ebb-6f246308439f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:33.332842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 816/1637] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:33.334776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcddad-f219-4ed4-bd8d-8da2d063f8c8 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.336760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcddad-f219-4ed4-bd8d-8da2d063f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.337786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcddad-f219-4ed4-bd8d-8da2d063f8c8 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.339495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 817/1638] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:19:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:33.342522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a60f-718d-46a8-bb20-edc0bb714ea6 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.345194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a60f-718d-46a8-bb20-edc0bb714ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.345695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a60f-718d-46a8-bb20-edc0bb714ea6 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.352661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 818/1639] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:19:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:33.353678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4a60f-718d-46a8-bb20-edc0bb714ea6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.384871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e2a76beab7414ebfc18ae310b44ee7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:33.386685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e2a76beab7414ebfc18ae310b44ee7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:33.406153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e2a76beab7414ebfc18ae310b44ee7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:33.450209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e2a76beab7414ebfc18ae310b44ee7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:33.483379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4a60f-718d-46a8-bb20-edc0bb714ea6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:33.489369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:33.490677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.491156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.491716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.492603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:33.495035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb025fd-6adc-4a51-9228-c7bb5e4461a8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:33.528438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4213d5c9-06a3-4f59-aa41-9aa4fdfab38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e2a76beab7414ebfc18ae310b44ee7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:33.538607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 822/1640] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:32 2022] DELETE /identity/v3/users/f9e2a76beab7414ebfc18ae310b44ee7 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:33.539204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326078-bb62-448e-aa38-440060205cc1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.539635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326078-bb62-448e-aa38-440060205cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.540083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326078-bb62-448e-aa38-440060205cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.566377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2b326078-bb62-448e-aa38-440060205cc1 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:33.567954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2b326078-bb62-448e-aa38-440060205cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.598192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 819/1641] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/users => generated 308 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:33.598192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.598192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.598192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.637180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:33.639879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.678417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 823/1642] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:33.680858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.681361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.681708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.704289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:33.709706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.822858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 824/1643] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:33.822858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.824300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 820/1644] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:19:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:33.833128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.833265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.847119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a2e9-864a-41b2-a28c-60e1c182af87 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:33.853446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:33.854274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.854733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.855962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.856810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:33.859189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d066cc-bfce-4d8c-9ca8-cc637e9189e5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:33.861706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ba94-7d89-48a1-837d-05d66bb243b5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:33.872926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 825/1645] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:33.874615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.875095 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.875545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.882073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 826/1646] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 12 08:19:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:33.883803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:33.886253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:33.895823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:33.897093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:33.899992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:33.900507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:33.909232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:34.003650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856db7a-eea9-4764-aadf-692b465d2da4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:34.016070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:34.016754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.017040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.017298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.043551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.046357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.047818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.051707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886d11-25c7-41fd-a104-0f2ac4a09ce6 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.070298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 827/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:34.071145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:34.083904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 821/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:34.085459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.085771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.086054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.096981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52776b74-5b6e-4ee7-884c-6b5651dd6ce4 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:34.117930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:34.117930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.117930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.117930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] PATH_INFO: `/v3/projects/6224493342ce4c54bdd024dd8ade9c63/users/c0de68400ab24550af20f0b20054ef2d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.129885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:34.133634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:34.155592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224493342ce4c54bdd024dd8ade9c63, user_id=c0de68400ab24550af20f0b20054ef2d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.158284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.159779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 822/1649] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:19:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:34.178532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:34.181919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:34.257069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 828/1650] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:34 2022] PUT /identity/v3/projects/6224493342ce4c54bdd024dd8ade9c63/users/c0de68400ab24550af20f0b20054ef2d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:34.260456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:34.310664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6db30-71a9-4b68-9d7d-e677d6511102 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:34.406416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:34.407105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.407366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.407663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.418577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a49e-e5bd-4bd5-9c89-950a48e5d147 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:34.432536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:34.432904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.433565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.433850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.434609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.441821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.464276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 829/1651] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:34.465059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:34.485779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7dfd-abf8-46b2-81e5-e01844ecb06a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:34.499726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:34.500638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.500924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.501198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] PATH_INFO: `/v3/projects/6224493342ce4c54bdd024dd8ade9c63/users/c0de68400ab24550af20f0b20054ef2d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.508609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224493342ce4c54bdd024dd8ade9c63, user_id=c0de68400ab24550af20f0b20054ef2d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.518597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eda51-9c9e-4802-8e4e-0b33db11c733 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.537102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 830/1652] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:34 2022] PUT /identity/v3/projects/6224493342ce4c54bdd024dd8ade9c63/users/c0de68400ab24550af20f0b20054ef2d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:34.568276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:34.569825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41648b9c-e89c-4688-82ba-9d6eb0a16669 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:34.602322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 823/1653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:34.705887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.706448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.706556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.708066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 831/1654] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 12 08:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:34.721202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:34.721420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:34.721630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:34.773109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:34.779285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:35.086038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 824/1655] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:19:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:35.101770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:35.101770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:35.172517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c3c3-a6f2-471f-969e-64b9641bba1b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:35.176413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:35.177069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:35.178242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:35.178648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:35.203957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:35.207691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200b03-29ee-45bb-9a5e-ccd063326f14 service glance] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:35.245321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 832/1656] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:35.947121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:35.950003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.102266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd838d-3168-433b-97d0-4dd2c87cd5ce None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:36.109653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:36.111099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] PATH_INFO: `/v3/users/28cdd27e0b5c4f7b9a1829ae7a29ed77` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cdd27e0b5c4f7b9a1829ae7a29ed77)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: WARNING py.warnings [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: warnings.warn(msg) Apr 12 08:19:36.115423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: Apr 12 08:19:36.115920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:36.276272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b4ef-606e-4ac9-8217-1b2fc76b8e1e None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.278054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b4ef-606e-4ac9-8217-1b2fc76b8e1e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.286371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b4ef-606e-4ac9-8217-1b2fc76b8e1e None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:36.289947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 833/1657] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 12 08:19:36 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:36.305297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606eb7-1fc9-4d42-ac7d-bc52b1b44ac0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.305751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606eb7-1fc9-4d42-ac7d-bc52b1b44ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.306119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606eb7-1fc9-4d42-ac7d-bc52b1b44ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:36.359079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cdd27e0b5c4f7b9a1829ae7a29ed77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:36.426182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cdd27e0b5c4f7b9a1829ae7a29ed77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:36.431403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-cb606eb7-1fc9-4d42-ac7d-bc52b1b44ac0 None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:36.449802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cb606eb7-1fc9-4d42-ac7d-bc52b1b44ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.486773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cdd27e0b5c4f7b9a1829ae7a29ed77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:36.578875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 834/1658] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:36.579314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cdd27e0b5c4f7b9a1829ae7a29ed77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:36.580215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cdd27e0b5c4f7b9a1829ae7a29ed77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:36.597073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 825/1659] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:35 2022] DELETE /identity/v3/users/28cdd27e0b5c4f7b9a1829ae7a29ed77 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:36.598777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.599154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.599535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:36.624802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:36.626319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.723588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:36.729961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.799072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 835/1660] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:36.818517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:36.820309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.889062 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12627a-61eb-406e-a878-8befb034f5c5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:36.912417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:36.914077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.916673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.916990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:36.924113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:36.966324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:36.973323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064abce-3863-4735-873f-e83c66a3ffac None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:36.976989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:36.984151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:36.985071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:36.985494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:36.985904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:37.006458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 826/1661] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:37.010561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:37.014344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9c02-7ef5-44e4-ba09-acb6a755edf0 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:37.046086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 836/1662] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:37.085059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:37.090628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:37.118948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661ffe-a7f6-4d15-bf0f-b9e383bcd891 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:37.162249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:37.163335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:37.164207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:37.164581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] PATH_INFO: `/v3/projects/8859054dce104e4f92d446e603343ffc` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:37.166464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8859054dce104e4f92d446e603343ffc)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:37.168605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:37.347759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8859054dce104e4f92d446e603343ffc', 'request_id': 'req-7070dc15-4688-4c51-9ef3-e1dece63e52a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:37.360673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8859054dce104e4f92d446e603343ffc', 'request_id': 'req-7070dc15-4688-4c51-9ef3-e1dece63e52a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:37.428596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:37.429609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:37.429692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:37.460176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8859054dce104e4f92d446e603343ffc', 'request_id': 'req-7070dc15-4688-4c51-9ef3-e1dece63e52a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:37.483349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] MFA Rules not processed for user `4c69d1709721460eb77784d0f468c9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:37.483559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] The token cache is being invalidate because project 8859054dce104e4f92d446e603343ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:37.483998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:37.484671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:37.485278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:37.489200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 827/1663] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:37 2022] DELETE /identity/v3/projects/8859054dce104e4f92d446e603343ffc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:37.506563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:37.513122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:37.672847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 837/1664] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:37.697363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070dc15-4688-4c51-9ef3-e1dece63e52a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:37.704664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:37.706175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:37.709298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:37.713292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:37.713763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:37.714633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] PATH_INFO: `/v3/users/5b33446c7909470fac6bcbcc4ac6ba10` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:37.724956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b33446c7909470fac6bcbcc4ac6ba10)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:37.728918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:37.958288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed78e75-2615-46ee-b968-fef0602f9874 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:37.975016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:37.976665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:37.976956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:37.977237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:37.989739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b33446c7909470fac6bcbcc4ac6ba10'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:38.013848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b33446c7909470fac6bcbcc4ac6ba10'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:38.016936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:38.025410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aadb3-7471-402d-8fd8-48c56ec95d11 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:38.063235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b33446c7909470fac6bcbcc4ac6ba10'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:38.076914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 838/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:38.169012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b33446c7909470fac6bcbcc4ac6ba10'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:38.171115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03067a06-f1fe-4837-a6d8-8ddec7848c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b33446c7909470fac6bcbcc4ac6ba10'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:38.179505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 828/1666] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:37 2022] DELETE /identity/v3/users/5b33446c7909470fac6bcbcc4ac6ba10 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:38.305713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:38.308657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:38.309902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:38.388335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] MFA Rules not processed for user `c0de68400ab24550af20f0b20054ef2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:38.406376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:38.410303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdc35-35f8-42fb-a380-cbcd9fd4e21e None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:38.410303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdc35-35f8-42fb-a380-cbcd9fd4e21e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:38.410303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdc35-35f8-42fb-a380-cbcd9fd4e21e None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:38.411531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 829/1667] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 12 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:19:38.418806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:38.419672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:38.420089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:38.473043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] MFA Rules not processed for user `3d3c0373ebde41b9aac512bf44553b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:38.476871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:38.678622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 839/1668] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:38.681083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:38.683313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 830/1669] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 12 08:19:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:38.684933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:38.692822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:38.710092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a9ecc-e17c-4396-85c3-0aea15653b49 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:38.723041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:38.723041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:38.723328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:38.723785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:38.727226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:38.754155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:38.758208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:38.775803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 831/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:38.831870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e9eae-4579-4524-b598-fabdf32a1ff9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:38.839896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:38.841548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:38.842277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:38.842696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] PATH_INFO: `/v3/projects/8c06f066036c40d398859d28921ddbe5` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:38.846445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c06f066036c40d398859d28921ddbe5)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:38.847614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: WARNING py.warnings [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 08:19:38.847614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: warnings.warn(msg) Apr 12 08:19:38.847614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: Apr 12 08:19:38.854974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:39.045473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c06f066036c40d398859d28921ddbe5', 'request_id': 'req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.074104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c06f066036c40d398859d28921ddbe5', 'request_id': 'req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.145440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c06f066036c40d398859d28921ddbe5', 'request_id': 'req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.205633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] The token cache is being invalidate because project 8c06f066036c40d398859d28921ddbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:39.205920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.207077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.209359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 840/1671] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:38 2022] DELETE /identity/v3/projects/8c06f066036c40d398859d28921ddbe5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:39.213324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:39.228203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd539a7-d1ee-408c-92d7-26a2750fab4b service placement] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:39.326142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:39.327337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:39.327904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:39.328424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] PATH_INFO: `/v3/users/79f26cd360144dbc9fdabaae4bebe164` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:39.329783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f26cd360144dbc9fdabaae4bebe164)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:39.332763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:39.569939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f26cd360144dbc9fdabaae4bebe164'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.577796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:39.579599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:39.589938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f26cd360144dbc9fdabaae4bebe164'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.618812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7aae7-cc6f-40a3-b859-2f3ca770b8e1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:39.620109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f26cd360144dbc9fdabaae4bebe164'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.651350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:39.652525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:39.653181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:39.653181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] PATH_INFO: `/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:39.660166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=644bdb31a9b04776b1cd0efe7b65daa5)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:39.662102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:39.717582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f26cd360144dbc9fdabaae4bebe164'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.718379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b142559-c529-4ab6-bf2f-3fe28af932c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f26cd360144dbc9fdabaae4bebe164'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.737561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 832/1672] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:39 2022] DELETE /identity/v3/users/79f26cd360144dbc9fdabaae4bebe164 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:39.892177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644bdb31a9b04776b1cd0efe7b65daa5', 'request_id': 'req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:39.909094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644bdb31a9b04776b1cd0efe7b65daa5', 'request_id': 'req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:40.002225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644bdb31a9b04776b1cd0efe7b65daa5', 'request_id': 'req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:40.021286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] The token cache is being invalidate because project 644bdb31a9b04776b1cd0efe7b65daa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:40.028590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:40.029879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7b4c7527-a49e-4d6a-95e2-5e5153a269ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:40.032241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 841/1673] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:39 2022] DELETE /identity/v3/projects/644bdb31a9b04776b1cd0efe7b65daa5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:40.036738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.037419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.038010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.058340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:40.060024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:40.216019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 833/1674] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:40.223724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.224281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.224659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.260206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:40.260206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:40.287979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 842/1675] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:40.292174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.309949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89efd1-b660-4338-a333-4db664984a66 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.328386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.329076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.329363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.329641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.330387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:40.330696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:40.348946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:40.380688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 834/1676] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:40.385353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.401054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522c15-b9c4-45b9-848f-b6eea323e787 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.425184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.426348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.426645 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.426919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.427665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:40.431604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:40.560666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 843/1677] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:40 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:40.564405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.578842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abc725-26fc-487d-8b1c-ad778d11e1f9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.650038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.651142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.652599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.653074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.654001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:40.656650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:40.755409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 835/1678] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:40 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:40.759453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.780382 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d10b-2a40-407e-aeee-62fbe45d02be admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.802275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.803838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.806172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.806731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.809046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:40.812118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:40.846770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 844/1679] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:40.852996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.868356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0f3-10fd-41a6-93e3-13536ea3cb52 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.901576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.902311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.906240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.906627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:40.907531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:40.910627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec466749-7871-4612-b9fb-e4ce64126ca8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:40.934626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 836/1680] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:40.938963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:40.956307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5afc-e2a2-4da7-8941-6a567402134e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:40.962828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:40.964094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:40.964501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:40.965014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] PATH_INFO: `/v3/projects/7625ef56f68d41afa5a3fe07b11642a5/users/b4527b048f5f427589a511a5fb5f0b7c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:41.011032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7625ef56f68d41afa5a3fe07b11642a5, user_id=b4527b048f5f427589a511a5fb5f0b7c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:41.018511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:41.102765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 845/1681] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:40 2022] PUT /identity/v3/projects/7625ef56f68d41afa5a3fe07b11642a5/users/b4527b048f5f427589a511a5fb5f0b7c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:41.117885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:41.118863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:41.119333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:41.253313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] MFA Rules not processed for user `b4527b048f5f427589a511a5fb5f0b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:41.255201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:41.372599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 837/1682] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:41.374212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:41.500249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9247a-8455-4d33-85c6-b24d5352c6bc admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:41.509004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:41.512673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:41.512972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:41.513257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:41.513984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:41.518193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:41.661504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 846/1683] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:41 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:41.668421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:41.695195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef900b-c189-4297-b5b7-3fd2fd9a65e7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:41.837964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:41.838972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:41.839315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:41.839700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:41.841006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:41.845607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:41.913988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:41.916868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:41.942389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df2301-53b4-4cae-afe1-d0519e45f86e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:41.948150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 838/1684] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:41 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:41.951435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:41.951735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:41.953283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:41.953807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:41.954248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:41.954479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] PATH_INFO: `/v3/users/f0510819592c416da20562e641a7ed0a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:41.956226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0510819592c416da20562e641a7ed0a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:41.958461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:41.987401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821fe9-7f02-4be5-a7c9-afd882be3caa admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:42.020227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:42.021126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.021507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.029013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] PATH_INFO: `/v3/projects/bda4130a20e6461d854e32a7cc08f967` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.031997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda4130a20e6461d854e32a7cc08f967)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:42.038482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:42.268486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda4130a20e6461d854e32a7cc08f967', 'request_id': 'req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.276648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda4130a20e6461d854e32a7cc08f967', 'request_id': 'req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.293919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0510819592c416da20562e641a7ed0a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.294877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0510819592c416da20562e641a7ed0a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.333965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0510819592c416da20562e641a7ed0a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.371293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0510819592c416da20562e641a7ed0a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.389657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda4130a20e6461d854e32a7cc08f967', 'request_id': 'req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.421707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] The token cache is being invalidate because project bda4130a20e6461d854e32a7cc08f967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:42.422001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.424786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.444220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 839/1685] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:41 2022] DELETE /identity/v3/projects/bda4130a20e6461d854e32a7cc08f967 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:42.448973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:42.454210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:42.471564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9ac42d81-2557-4d8e-ad26-903dc8e5b267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0510819592c416da20562e641a7ed0a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:42.481668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 847/1686] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:41 2022] DELETE /identity/v3/users/f0510819592c416da20562e641a7ed0a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:42.486410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf56c5-c379-4e7b-91e0-bab2358676bc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.486743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf56c5-c379-4e7b-91e0-bab2358676bc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.489200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf56c5-c379-4e7b-91e0-bab2358676bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.584476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-31bf56c5-c379-4e7b-91e0-bab2358676bc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:42.592140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-31bf56c5-c379-4e7b-91e0-bab2358676bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:42.712567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba2fb-bfaf-4631-b2ad-57562a0253dd admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:42.725722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:42.734383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 848/1687] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:42.735548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.736076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.736076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.736913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.738709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:42.739774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.740279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.742487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:42.762185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 840/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:42.763225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:42.792328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:42.793804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:42.812199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5738e-6d34-4ee6-831a-0d788bacebd0 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:42.817309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 849/1689] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:42.822320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:42.829226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:42.831022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.831849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.832014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] PATH_INFO: `/v3/projects/0d64170b4a624668aa1972b4280539ad/users/53307f2e13824372b67f799f8765b9cf/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.834443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebc06-d4b8-4dee-8c99-8ece4030a842 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:42.842386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:42.843302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.843825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.844255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.845283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:42.845734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:42.847735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:42.865443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d64170b4a624668aa1972b4280539ad, user_id=53307f2e13824372b67f799f8765b9cf, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:42.870964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:42.872657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 850/1690] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:42.876789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:42.890700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4235-496d-46cd-9678-e4e71106b2b0 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:42.902338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:42.903555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:42.903992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:42.904459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:42.905319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:42.908112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:42.977922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 841/1691] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:42 2022] PUT /identity/v3/projects/0d64170b4a624668aa1972b4280539ad/users/53307f2e13824372b67f799f8765b9cf/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:42.982080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.015198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 851/1692] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:42 2022] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:43.018965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.164216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e04a-2d86-4449-9ac0-790829e2f04f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.222622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749de8-709c-4c9f-8af6-e47c84447205 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.260193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.260917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.261209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.261490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.262202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.289870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.340268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.341161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.341161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.343071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.344063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.346029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.362537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 842/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:43.367202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.389672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb1e9-02d7-4f20-a4a7-3c65bdb4cb23 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.399100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.406078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 852/1694] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:43 2022] POST /identity/v3/users => generated 301 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:19:43.409747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.415192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.415545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.415796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] PATH_INFO: `/v3/projects/0d64170b4a624668aa1972b4280539ad/users/53307f2e13824372b67f799f8765b9cf/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.419359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d64170b4a624668aa1972b4280539ad, user_id=53307f2e13824372b67f799f8765b9cf, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.422045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.422159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6365-25c4-45af-a3d2-d2c8f075d96f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.429875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.430751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.431089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.433203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.433203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.434208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65dae-5180-49ea-91d6-7ff89e0d9c13 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.448486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 843/1695] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:43 2022] PUT /identity/v3/projects/0d64170b4a624668aa1972b4280539ad/users/53307f2e13824372b67f799f8765b9cf/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:19:43.457906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 853/1696] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:43.459254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.459574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.460500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.460902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.485686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:43.487175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:43.538790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb28c-8734-4b60-a137-4a2047d3cb0a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.544509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.545187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.545472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.545746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.546480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.548125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27613c2c-d3ad-454d-b792-78ba974bf0ff admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.564404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 844/1697] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:43.565880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.566175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.566462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.571792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 854/1698] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:43.572929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.590933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd022-b535-4b56-86ec-f6dea24db83c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:43.598358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:43.599375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.599847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.600213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] PATH_INFO: `/v3/projects/1ada3ab7d3414a1c8af1371d096cfe7e/users/f52bf6d97a3446fa9c9f86aadd73cb6e/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.622116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] MFA Rules not processed for user `53307f2e13824372b67f799f8765b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:43.624041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ada3ab7d3414a1c8af1371d096cfe7e, user_id=f52bf6d97a3446fa9c9f86aadd73cb6e, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:43.626041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:43.627048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dfde7-680d-4f90-b23a-1a6683071818 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:43.736459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 855/1699] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:43 2022] PUT /identity/v3/projects/1ada3ab7d3414a1c8af1371d096cfe7e/users/f52bf6d97a3446fa9c9f86aadd73cb6e/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:43.747133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:43.747560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:43.747938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:43.772041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 845/1700] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:43.785998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:43.787680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:43.852721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] MFA Rules not processed for user `f52bf6d97a3446fa9c9f86aadd73cb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:43.857457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:43.935981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b43a5-61d1-4819-ab0c-087babc286f1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.000721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 856/1701] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:44.008314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:44.086103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.086992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.087557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.087996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.175142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746315f-5aa6-449d-877e-85c69c4f994f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.200199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.202420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.202924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.203212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.205686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.209754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.251635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.253110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.279628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 846/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:44.280699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:44.282138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:44.367202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 857/1703] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:44 2022] POST /identity/v3/projects => generated 399 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:44.368151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:44.452674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e75e-7872-4f95-a487-4d32a724df0d service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.502472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eb20-f5ab-4b4f-882f-d4afc07fe4cc admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.514892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.516925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.517228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.517487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] PATH_INFO: `/v3/users/b4527b048f5f427589a511a5fb5f0b7c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.523789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4527b048f5f427589a511a5fb5f0b7c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.527131 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.534648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.535322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.537244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.537244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.612221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.613912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.625448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 847/1704] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:19:44.626354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:44.638438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660675-8691-46ad-86a4-526051dbe95a service swift] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.647325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.648199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.648806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.649097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.649854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.652209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.766824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 848/1705] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:44 2022] POST /identity/v3/users => generated 306 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:44.766824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:44.766824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:44.772835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4527b048f5f427589a511a5fb5f0b7c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.795008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4527b048f5f427589a511a5fb5f0b7c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.796897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad71-d195-4127-b107-45280ecb1b3d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:44.810996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:44.812084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:44.812306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:44.812633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] PATH_INFO: `/v3/projects/533640587642423aa4e0053ba31626e1` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:44.813860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=533640587642423aa4e0053ba31626e1)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:44.816047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:44.818168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4527b048f5f427589a511a5fb5f0b7c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.862490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4527b048f5f427589a511a5fb5f0b7c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.974820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533640587642423aa4e0053ba31626e1', 'request_id': 'req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.974947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4527b048f5f427589a511a5fb5f0b7c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.985295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533640587642423aa4e0053ba31626e1', 'request_id': 'req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:44.993420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 858/1706] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:44 2022] DELETE /identity/v3/users/b4527b048f5f427589a511a5fb5f0b7c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:44.996878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:45.003198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:45.048145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533640587642423aa4e0053ba31626e1', 'request_id': 'req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.089321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] The token cache is being invalidate because project 533640587642423aa4e0053ba31626e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:45.089945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.096689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.104858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 849/1707] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:44 2022] DELETE /identity/v3/projects/533640587642423aa4e0053ba31626e1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:45.107573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:45.114947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:45.136135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae0b5-0a0b-4382-bfe8-01f228c97512 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:45.144927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:45.145771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:45.146432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:45.146947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:45.148566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:45.151290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56181ae-9599-4e54-a157-51632ad7ed75 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:45.173190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 859/1708] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:45.175246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:45.175832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:45.175832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:45.220000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:45.222755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:45.254829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 860/1709] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:45.256316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:45.259074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:45.284995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ab04-9bb9-4cd5-9f37-35076206b763 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:45.291354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:45.292285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:45.292564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:45.292849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] PATH_INFO: `/v3/users/c0de68400ab24550af20f0b20054ef2d` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:45.294252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0de68400ab24550af20f0b20054ef2d)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:45.296742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:45.400663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fae7f8-d7f0-4549-82b2-56bdb593a7df admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:45.406775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:45.408525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:45.408525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:45.408835 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] PATH_INFO: `/v3/users/c85d792a3c7f41c785fb2fe0080878ea` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:45.411414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85d792a3c7f41c785fb2fe0080878ea)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:45.414168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:45.616477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0de68400ab24550af20f0b20054ef2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.619314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0de68400ab24550af20f0b20054ef2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.646348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0de68400ab24550af20f0b20054ef2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.657886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85d792a3c7f41c785fb2fe0080878ea'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.674565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85d792a3c7f41c785fb2fe0080878ea'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.690013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0de68400ab24550af20f0b20054ef2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.703737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85d792a3c7f41c785fb2fe0080878ea'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.762802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0de68400ab24550af20f0b20054ef2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.774316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 861/1710] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:45 2022] DELETE /identity/v3/users/c0de68400ab24550af20f0b20054ef2d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:45.787027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:45.796028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:45.830352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85d792a3c7f41c785fb2fe0080878ea'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.831082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85d792a3c7f41c785fb2fe0080878ea'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:45.841151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 850/1711] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:45 2022] DELETE /identity/v3/users/c85d792a3c7f41c785fb2fe0080878ea => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:45.844549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:45.851791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.056246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b30c-7317-48d8-aa80-e63bd115350b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:46.056862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35f7a-76f3-42ab-b2a9-a82563e84366 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:46.056862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:46.056862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.056862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.057261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.057261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.092721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:46.107835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.107835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.107835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] PATH_INFO: `/v3/projects/e096116e227840fc9f9d130be3673c26/users/f1c4fbb52ba94ee4862a075a4654c464/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.146477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e096116e227840fc9f9d130be3673c26, user_id=f1c4fbb52ba94ee4862a075a4654c464, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:46.150570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8130c3-b545-418f-b6ad-6ded3e9911c8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:46.182588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:46.183528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f16598-5675-4a5f-901f-b0efe3214c2a service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:46.215454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 851/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:46.218599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723ce8-6503-4a86-9d27-e34b780d58f6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.220314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723ce8-6503-4a86-9d27-e34b780d58f6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.222373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723ce8-6503-4a86-9d27-e34b780d58f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.279732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-55723ce8-6503-4a86-9d27-e34b780d58f6 None None] MFA Rules not processed for user `ad2204eb50114552898320fcdb5577d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:46.282268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-55723ce8-6503-4a86-9d27-e34b780d58f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.377949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 862/1713] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:45 2022] PUT /identity/v3/projects/e096116e227840fc9f9d130be3673c26/users/f1c4fbb52ba94ee4862a075a4654c464/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:46.379216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.379938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.380231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.386982 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 852/1714] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:46.390430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.390430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.390430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.416987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:46.418625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.462251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] MFA Rules not processed for user `88c132a4d80d40cd810b5d5b0eeda77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:46.464722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.590268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 863/1715] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:46.593474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:46.595655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.611072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 853/1716] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:46.611072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:46.613614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.652491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7696-8bfe-4c9b-82eb-70c63160769a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:46.692640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:46.692640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.700258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.713671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.720274 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:46.734490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670dc5a-5669-4a5e-a76a-9864f75590de admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:46.804779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 864/1717] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:46.806359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.810114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.811739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:46.856584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] MFA Rules not processed for user `88c132a4d80d40cd810b5d5b0eeda77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:46.862605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:46.880874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 865/1718] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:46.883775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:46.915314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd3c7-9110-4ee9-b662-8af70ff47db6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:46.935242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:46.935948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:46.936236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:46.936518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.080424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd810-17fe-4685-9bbb-cd4e74e95ff5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:47.092785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:47.093473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.093784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.095567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.111009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:47.122926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:47.126705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:47.128331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:47.163456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 866/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:47.164592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:47.167193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:47.197764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29b10-99a7-4614-a56f-7ecb61e4ea66 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:47.199454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 854/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:47.204648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:47.214529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:47.215555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.215846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.216119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] PATH_INFO: `/v3/projects/6224493342ce4c54bdd024dd8ade9c63` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.219164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6224493342ce4c54bdd024dd8ade9c63)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:47.221508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:47.258642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0d1fd-f665-4077-9a65-da1306357cd3 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:47.274878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:47.278470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.278863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.280958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] PATH_INFO: `/v3/projects/e096116e227840fc9f9d130be3673c26/users/f1c4fbb52ba94ee4862a075a4654c464/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.292553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e096116e227840fc9f9d130be3673c26, user_id=f1c4fbb52ba94ee4862a075a4654c464, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:47.304658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f247c76-1c57-4b63-8682-2718d7b4748a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:47.388605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 855/1721] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:47 2022] PUT /identity/v3/projects/e096116e227840fc9f9d130be3673c26/users/f1c4fbb52ba94ee4862a075a4654c464/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:47.401650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.402257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.402487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.404460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6224493342ce4c54bdd024dd8ade9c63', 'request_id': 'req-5b51c492-e808-431f-af79-1160f1e82e45'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:47.433624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6224493342ce4c54bdd024dd8ade9c63', 'request_id': 'req-5b51c492-e808-431f-af79-1160f1e82e45'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:47.489967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] MFA Rules not processed for user `f1c4fbb52ba94ee4862a075a4654c464`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:47.495051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:47.584800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6224493342ce4c54bdd024dd8ade9c63', 'request_id': 'req-5b51c492-e808-431f-af79-1160f1e82e45'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:47.614160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] The token cache is being invalidate because project 6224493342ce4c54bdd024dd8ade9c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:47.614439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:47.615833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-5b51c492-e808-431f-af79-1160f1e82e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:47.626932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 867/1722] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:47 2022] DELETE /identity/v3/projects/6224493342ce4c54bdd024dd8ade9c63 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:47.629206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d36f-b5c2-4011-ad9c-8ec1b8776b66 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.629398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d36f-b5c2-4011-ad9c-8ec1b8776b66 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.629651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d36f-b5c2-4011-ad9c-8ec1b8776b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.694436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7ad5d36f-b5c2-4011-ad9c-8ec1b8776b66 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:47.696112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7ad5d36f-b5c2-4011-ad9c-8ec1b8776b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:47.773592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 856/1723] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:47.789843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:47.791500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:47.846285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 868/1724] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:19:47.848374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d42d-9ef9-41b7-b465-7a70659b0f1d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.849225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d42d-9ef9-41b7-b465-7a70659b0f1d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.849508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d42d-9ef9-41b7-b465-7a70659b0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:47.882748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b592d42d-9ef9-41b7-b465-7a70659b0f1d None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:47.884172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b592d42d-9ef9-41b7-b465-7a70659b0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:47.982382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315076a3-83e1-4845-97ad-08105dbd1251 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:47.998077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:47.998822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:47.999109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:47.999381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.042750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.044261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325f7a1-8977-4028-b479-9391f3c318ce service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.083059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 857/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:19:48.084529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.085382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.086035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.133795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 869/1726] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Apr 12 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:48.135305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.139347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:48.140861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.143701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.144193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.172905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 858/1727] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:48.177014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:48.182009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.213955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] MFA Rules not processed for user `4c69d1709721460eb77784d0f468c9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:48.222032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.336175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e5ca3-cbe5-4129-84dd-0369b1d699bc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:48.351221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:48.353949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.354629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.355972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.362645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.454526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.456409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.470042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 859/1728] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:48.471302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:48.472884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.489205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4df7-be5a-417a-a40d-97210dd8fd25 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:48.504435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:48.504435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.504435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.504435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.520200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.521681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.537966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 860/1729] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:48.544173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:48.556381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7187deb-cdb1-47b0-b70b-0c29fbe20800 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:48.558255 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 870/1730] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:48.564676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:48.585832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:48.587069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.587511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.588041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.589020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:48.589610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.591382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.623453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f6df-af71-4426-8d35-fb952b0c54a8 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:48.634523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 861/1731] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:48.638145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:48.644707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.653908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:48.654577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.654858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.655133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.665608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:48.671191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4455-537f-414f-be15-dc8de5aaa6ae admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:48.678390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:48.679989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:48.680385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:48.680759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] PATH_INFO: `/v3/projects/7625ef56f68d41afa5a3fe07b11642a5` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:48.682080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7625ef56f68d41afa5a3fe07b11642a5)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.685131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.867435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7625ef56f68d41afa5a3fe07b11642a5', 'request_id': 'req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:48.892095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7625ef56f68d41afa5a3fe07b11642a5', 'request_id': 'req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:48.966057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:48.972394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:48.979425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7625ef56f68d41afa5a3fe07b11642a5', 'request_id': 'req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.010557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] The token cache is being invalidate because project 7625ef56f68d41afa5a3fe07b11642a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:49.011141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.012156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.019303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 871/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:49.033624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 862/1733] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:48 2022] DELETE /identity/v3/projects/7625ef56f68d41afa5a3fe07b11642a5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:49.034902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:49.042549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:49.046023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:49.107020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eedf2-7151-4058-b235-a9b736a13878 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:49.373817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:49.377515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:49.377687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:49.378958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:49.385146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:49.390396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:49.408916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19bc0b-b232-4555-ab58-9bdbf9cb889b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:49.420776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:49.421916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:49.422244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:49.422567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] PATH_INFO: `/v3/users/53307f2e13824372b67f799f8765b9cf` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:49.424030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53307f2e13824372b67f799f8765b9cf)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:49.438117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:49.482436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 872/1734] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:49 2022] POST /identity/v3/projects => generated 371 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:49.483905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:49.487662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:49.741652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53307f2e13824372b67f799f8765b9cf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.764684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53307f2e13824372b67f799f8765b9cf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.807792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53307f2e13824372b67f799f8765b9cf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.822290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97c18c-367d-41ef-8733-67256b36fe68 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:49.837283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:49.838288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:49.838700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:49.839076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] PATH_INFO: `/v3/projects/e8a7eb9cd0a5419ea69d5078791ea4b2` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:49.840979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a7eb9cd0a5419ea69d5078791ea4b2)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:49.844393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:49.882625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53307f2e13824372b67f799f8765b9cf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.883663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53307f2e13824372b67f799f8765b9cf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:49.913720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 863/1735] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:49 2022] DELETE /identity/v3/users/53307f2e13824372b67f799f8765b9cf => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:49.916163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:49.937165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.138819 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a7eb9cd0a5419ea69d5078791ea4b2', 'request_id': 'req-42624e16-2856-4996-b8a4-eb100861f225'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:50.151701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a7eb9cd0a5419ea69d5078791ea4b2', 'request_id': 'req-42624e16-2856-4996-b8a4-eb100861f225'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:50.167680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367243f-5206-4f12-9e85-43cd0c8194d8 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:50.230996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a7eb9cd0a5419ea69d5078791ea4b2', 'request_id': 'req-42624e16-2856-4996-b8a4-eb100861f225'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:50.271380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] The token cache is being invalidate because project e8a7eb9cd0a5419ea69d5078791ea4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:50.271836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:50.274460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42624e16-2856-4996-b8a4-eb100861f225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:50.293116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 873/1736] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:49 2022] DELETE /identity/v3/projects/e8a7eb9cd0a5419ea69d5078791ea4b2 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:50.295407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335d13-cd0b-4460-aaec-765c90dc4fe0 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.295690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335d13-cd0b-4460-aaec-765c90dc4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.296034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335d13-cd0b-4460-aaec-765c90dc4fe0 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.299563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 874/1737] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 12 08:19:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:50.306076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f848-959e-4a3a-aba2-d3fa3b72d63a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.306278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f848-959e-4a3a-aba2-d3fa3b72d63a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.306551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f848-959e-4a3a-aba2-d3fa3b72d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.392538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c567f848-959e-4a3a-aba2-d3fa3b72d63a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:50.395588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c567f848-959e-4a3a-aba2-d3fa3b72d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.395713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:50.396804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.397157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.397745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.400226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:50.407397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa0f4-b9cb-45e2-b5da-1fea5ce59ff4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:50.433228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 875/1738] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:50.434649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.434939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.435313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.485037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:50.488700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.545924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 864/1739] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:49 2022] POST /identity/v3/users => generated 286 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:50.549457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.549754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.550045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.640536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:50.641791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.681849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 865/1740] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:50.682817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:50.688983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.733941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 876/1741] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:19:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:50.735811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:50.746236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf09b8-175f-48c8-b852-2a7e9d4045f9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:50.773250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:50.773974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.774258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.774527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.774904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6bb45-aa38-4b56-973e-2a624bf95503 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:50.781782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:50.783589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:50.789474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:50.792516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.792812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.793276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.795176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:50.795539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:50.800836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:50.814748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 866/1742] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:50.815752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:50.830077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 877/1743] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:50.834722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:50.852808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a855-65b5-4dd3-b2da-c2212d45141e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:50.855824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c101a10-1ebd-4370-9de8-ecf2221f40e1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:50.868934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:50.874179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.874179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.874179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.874179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:50.874179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:50.874689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:50.874689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:50.874689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:50.874689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:50.875395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:50.877101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:50.910508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 867/1744] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:50.914767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:50.918085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:50.991365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171d31-1478-447e-82ac-59586195b0c3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.026698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.030436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.032326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.034583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.067759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 878/1745] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:50 2022] POST /identity/v3/projects => generated 403 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:51.071042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:51.075763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.085579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.131340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 868/1746] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:51.141222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:51.186184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f04de-1e6e-4533-865f-ed725b382db1 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.259759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.260511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.260901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.261281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.262653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.265107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.332982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f8ca0-aefe-4dca-beae-e493cb2aa21f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.365077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.367183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.369362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.369953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] PATH_INFO: `/v3/projects/dae3ec6e1bb94e06aac221239c087db0/users/731b765267f9442bb483fd53d4c6770e/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.395056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 869/1747] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:51 2022] POST /identity/v3/users => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:51.396258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:51.440838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae3ec6e1bb94e06aac221239c087db0, user_id=731b765267f9442bb483fd53d4c6770e, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.447046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714956-a728-4dda-8611-a57277831708 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.461594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4f92-12db-4cf0-adfc-35d7335dfc7d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.477211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.478502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.478502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.478502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.479420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.483370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.516643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 870/1748] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:51.516643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:51.542740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45977b24-64a8-4679-9cd8-47e400a2b557 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.553095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.554200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.554696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.555140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.556078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.558034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.583871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 871/1749] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:51.588100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:51.610190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 879/1750] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:51 2022] PUT /identity/v3/projects/dae3ec6e1bb94e06aac221239c087db0/users/731b765267f9442bb483fd53d4c6770e/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:51.612903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbbda-edea-47d1-a1e2-4183412c5f5c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:51.632354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7e1b-4527-459b-bb11-cdbd02caebf5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.633711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7e1b-4527-459b-bb11-cdbd02caebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.634020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7e1b-4527-459b-bb11-cdbd02caebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.761359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-479f7e1b-4527-459b-bb11-cdbd02caebf5 None None] MFA Rules not processed for user `731b765267f9442bb483fd53d4c6770e`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:51.763400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-479f7e1b-4527-459b-bb11-cdbd02caebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:51.855192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:51.856152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.863140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.878627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] PATH_INFO: `/v3/projects/b56e01fefb0f455cbd6704cd189dbacf/users/896b62df554d4ded9b7b3d54fc67ee9c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:51.914373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56e01fefb0f455cbd6704cd189dbacf, user_id=896b62df554d4ded9b7b3d54fc67ee9c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:51.919199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:51.980625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 880/1751] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:51.982498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:51.982869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:51.983224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.004042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] MFA Rules not processed for user `88c132a4d80d40cd810b5d5b0eeda77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:52.009348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:52.059544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 872/1752] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:51 2022] PUT /identity/v3/projects/b56e01fefb0f455cbd6704cd189dbacf/users/896b62df554d4ded9b7b3d54fc67ee9c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:52.060704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:52.150476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 881/1753] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:52.152010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:52.166595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:52.274312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7304-8f93-4985-9649-f11ef70cb9d0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:52.289946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:52.292371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a23a-f61c-4aa9-aed3-7dbca0d7815c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:52.294032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:52.294032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:52.296906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] PATH_INFO: `/v3/projects/0d64170b4a624668aa1972b4280539ad` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.312066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d64170b4a624668aa1972b4280539ad)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:52.314526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:52.345809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:52.345809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:52.345809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:52.345809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.346400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:52.346400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3d30-b4a7-4875-881f-4dcdb8411650 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:52.467424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 873/1754] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:52 2022] POST /identity/v3/projects => generated 371 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:52.483583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4484-2f39-4c69-a821-acd2f101b901 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:52.486213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4484-2f39-4c69-a821-acd2f101b901 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:52.489481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4484-2f39-4c69-a821-acd2f101b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.582362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-839e4484-2f39-4c69-a821-acd2f101b901 None None] MFA Rules not processed for user `896b62df554d4ded9b7b3d54fc67ee9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:52.587005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-839e4484-2f39-4c69-a821-acd2f101b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:52.605214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d64170b4a624668aa1972b4280539ad', 'request_id': 'req-7a354720-f5f0-4f15-b04e-08ee935b5baa'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:52.637327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d64170b4a624668aa1972b4280539ad', 'request_id': 'req-7a354720-f5f0-4f15-b04e-08ee935b5baa'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:52.699349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d64170b4a624668aa1972b4280539ad', 'request_id': 'req-7a354720-f5f0-4f15-b04e-08ee935b5baa'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:52.721979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] The token cache is being invalidate because project 0d64170b4a624668aa1972b4280539ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:19:52.722512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:52.727180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7a354720-f5f0-4f15-b04e-08ee935b5baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:52.729753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 882/1755] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:52 2022] DELETE /identity/v3/projects/0d64170b4a624668aa1972b4280539ad => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:52.731906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:52.749328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:52.750918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.761578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 883/1756] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:19:52 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:19:52.762771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:52.776398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:52.840411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 874/1757] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:52.847142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320d2b-704c-477e-bd83-9824844a552e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:52.848419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320d2b-704c-477e-bd83-9824844a552e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:52.849368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320d2b-704c-477e-bd83-9824844a552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:52.916762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-51320d2b-704c-477e-bd83-9824844a552e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:52.920454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-51320d2b-704c-477e-bd83-9824844a552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:53.065466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23625c69-cae8-4208-8280-4c3364d5f37f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.072752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.073492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.073827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.074306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.075169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.088367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.203149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 884/1758] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:52 2022] POST /identity/v3/users => generated 292 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:53.204385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.208664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:53.226558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 875/1759] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:53.231615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da2bd-63c9-4607-8f27-566c3096a940 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.231913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da2bd-63c9-4607-8f27-566c3096a940 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.232197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da2bd-63c9-4607-8f27-566c3096a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.243078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f088a3a-b79f-4851-9fbd-75b8efe8597d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.262470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.263051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.267345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.267345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.267345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.267345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.287222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-440da2bd-63c9-4607-8f27-566c3096a940 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:53.288538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-440da2bd-63c9-4607-8f27-566c3096a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:53.422066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 885/1760] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:53 2022] POST /identity/v3/projects => generated 405 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:53.428032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.430116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 876/1761] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:19:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:53.432119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.432550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.432928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.495163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:53.516823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:53.673086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 877/1762] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:53.675270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.690221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b29554-9afc-434a-9ec1-e3d3c1317eeb None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.698833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.699858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.700524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.701150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.702256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.705472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.724868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31724-ae48-414e-b714-f61041680947 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.731242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.732684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.733038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.733380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.734213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.736623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.786037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 886/1763] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:53.786037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.794844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 878/1764] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:53 2022] POST /identity/v3/users => generated 309 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:53.798547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.835726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e537-7312-4d25-92ca-072618f3f9dc admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.837714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4453de5-81ec-4781-ae5f-08e92e738795 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.851231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.856940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.857234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.857520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] PATH_INFO: `/v3/projects/0f78c9ea648646ce836bcef521289f21/users/28ec743aef384f4c9263f212c509b860/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.861196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.862867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.863157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.863434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.864205 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:19:53.864520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.866189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.926896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f78c9ea648646ce836bcef521289f21, user_id=28ec743aef384f4c9263f212c509b860, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.933316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 887/1765] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:19:53.935169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:53.937536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:53.972536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17024a-099c-40dd-b1f0-5cdca1858dba admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:53.984299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:53.985036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:53.985333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:53.985611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:53.988995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:53.990860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.029844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 888/1766] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:54.081541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 879/1767] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:53 2022] PUT /identity/v3/projects/0f78c9ea648646ce836bcef521289f21/users/28ec743aef384f4c9263f212c509b860/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:54.085270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.092091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.117914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99489b51-a1c1-4347-8d30-1ae518ede706 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.271136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863678ba-214c-48ee-90df-9bf78d9d8a33 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.284558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.290198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.290198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.290198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] PATH_INFO: `/v3/projects/ee027526a7044a72aafd1f9b017979ab/users/e1030b0cdd1049688d95316b4638f643/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.315112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee027526a7044a72aafd1f9b017979ab, user_id=e1030b0cdd1049688d95316b4638f643, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.322932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.394144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.394849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.397578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.397578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.400275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.402576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.482048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 880/1768] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:54 2022] PUT /identity/v3/projects/ee027526a7044a72aafd1f9b017979ab/users/e1030b0cdd1049688d95316b4638f643/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:54.483169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.488763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:54.565335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 889/1769] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:54 2022] POST /identity/v3/projects => generated 375 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:54.566381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.710537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b8ae-3040-4843-9589-bf15c0351d88 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.716848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae461-b429-47c0-909e-46b275ba3a2f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.738015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.738391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.738672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.738982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.739698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.741883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.762638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 890/1770] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:54.763542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.798736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc69e-b715-40f0-a907-ac3a9ba15a00 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.814499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.815184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.815490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.815805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.816548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.823069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.843664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 891/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:54.843664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.876786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de20ec7-cd80-49de-8b7c-744293d7a08b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:54.887553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.888247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.888532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.888809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.889846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.895213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.900339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:54.904210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:54.904681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:54.905395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:54.944117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:54.945805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:54.980151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 892/1772] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:54 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:54.981435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:54.997450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 881/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:55.008485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e624-7433-448e-80e7-2db1fed3fad8 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.012914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.016248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.017173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.017456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.017736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] PATH_INFO: `/v3/projects/0f78c9ea648646ce836bcef521289f21/users/28ec743aef384f4c9263f212c509b860/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.040313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f78c9ea648646ce836bcef521289f21, user_id=28ec743aef384f4c9263f212c509b860, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.043168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.069844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5050e3-6a6f-4b28-a87b-9e51fd3f759c service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.091253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 893/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:54 2022] PUT /identity/v3/projects/0f78c9ea648646ce836bcef521289f21/users/28ec743aef384f4c9263f212c509b860/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:55.091253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.237634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4290-f8d3-4550-b071-54b3dca7287d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.247607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.249376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.249376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.249376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] PATH_INFO: `/v3/projects/ee027526a7044a72aafd1f9b017979ab/users/e1030b0cdd1049688d95316b4638f643/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.253450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.254141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.254301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee027526a7044a72aafd1f9b017979ab, user_id=e1030b0cdd1049688d95316b4638f643, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.254421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.256992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.257155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8ec3-7367-457f-ae85-5537adcade8a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.278471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.278471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f665e-8185-4794-be9b-782d6a0e2e83 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.289253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 882/1775] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:54 2022] PUT /identity/v3/projects/ee027526a7044a72aafd1f9b017979ab/users/e1030b0cdd1049688d95316b4638f643/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:55.292928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.294313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.295983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.321755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 894/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:55.323188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.326066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.326384 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.369790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] MFA Rules not processed for user `28ec743aef384f4c9263f212c509b860`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:55.372524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:55.374950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] MFA Rules not processed for user `e1030b0cdd1049688d95316b4638f643`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:55.376307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:55.512559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 883/1777] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:55.513610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.634089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c63f4-7d7f-44ef-a20a-d856711a381d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.650826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.667614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.676595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.676595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.676595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.676595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.702796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 895/1778] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:55.703985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.714224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:55.714372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 884/1779] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:55.723586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.746444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb6bd-d3a6-41dd-b546-baf49ca8b52a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.752049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.753356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.754327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.754776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] PATH_INFO: `/v3/projects/b33a11c39976441e83abed16286bacb3/users/7b9f3baca64f4e4a9639ffdb3f95aba1/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.806908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33a11c39976441e83abed16286bacb3, user_id=7b9f3baca64f4e4a9639ffdb3f95aba1, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.810618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fd94f-5f01-4189-9c63-e34acd4587e9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.816613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b230a8-1fef-402d-b991-84a2de7dd2b4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.825425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.826187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.826474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.827708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.839865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.841410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.852978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 896/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:55.853971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:55.855531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:55.871721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885367e-4ca1-4eae-b92c-c9a79ddc61a0 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:55.881449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:55.890506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.890506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.890506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.914258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:55.921232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:55.941067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 885/1781] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:55 2022] PUT /identity/v3/projects/b33a11c39976441e83abed16286bacb3/users/7b9f3baca64f4e4a9639ffdb3f95aba1/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:55.945487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:55.948033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:55.948033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:55.986463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 897/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:56.022935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:56.025335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:56.066888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0596-9b64-4dc1-aa92-73fa2d48593f service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:56.070350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] MFA Rules not processed for user `7b9f3baca64f4e4a9639ffdb3f95aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:56.076060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:56.204649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 886/1783] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:56.221891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:56.317284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:56.318432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:56.319201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:56.320887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] PATH_INFO: `/v3/users/f52bf6d97a3446fa9c9f86aadd73cb6e` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:56.323118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52bf6d97a3446fa9c9f86aadd73cb6e)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:56.327240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:56.405889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ba80f-743d-4026-9d3e-fb6f34a2d3d3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:56.418436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:56.425229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:56.425593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:56.425927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:56.426754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:56.442666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:56.551275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52bf6d97a3446fa9c9f86aadd73cb6e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:56.552026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52bf6d97a3446fa9c9f86aadd73cb6e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:56.564712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52bf6d97a3446fa9c9f86aadd73cb6e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:56.575421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 887/1784] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:19:56 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:56.578074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:56.586442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:56.593923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52bf6d97a3446fa9c9f86aadd73cb6e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:56.681391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c4572fbe-f0d1-473a-adbb-dec2b51d0f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52bf6d97a3446fa9c9f86aadd73cb6e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:56.690055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 898/1785] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:56 2022] DELETE /identity/v3/users/f52bf6d97a3446fa9c9f86aadd73cb6e => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:56.691459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:56.691847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:56.692116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:56.755103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c600-2998-4a68-a32d-df13289b7d47 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:56.765749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] MFA Rules not processed for user `ad2204eb50114552898320fcdb5577d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:56.772863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:56.900904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 899/1786] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:56.900904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:56.909176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:56.954400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:56.956998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:56.962452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:56.963721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] PATH_INFO: `/v3/users/896b62df554d4ded9b7b3d54fc67ee9c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:56.967559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896b62df554d4ded9b7b3d54fc67ee9c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:56.970422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:57.138530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0888-ca1d-42c7-ae92-9b7b18793caa None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:57.158891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:57.160099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.160522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.160938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.161780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:57.165241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d31529-bb18-442f-a86f-a8940bb9f43f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:57.253589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896b62df554d4ded9b7b3d54fc67ee9c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.269142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896b62df554d4ded9b7b3d54fc67ee9c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.297820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 900/1787] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:19:56 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:19:57.299783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.300076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.300354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.307229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896b62df554d4ded9b7b3d54fc67ee9c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.351291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:57.354949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.382849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 901/1788] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:57.384714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:57.386237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.391118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896b62df554d4ded9b7b3d54fc67ee9c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.391976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896b62df554d4ded9b7b3d54fc67ee9c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.400683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 888/1789] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:56 2022] DELETE /identity/v3/users/896b62df554d4ded9b7b3d54fc67ee9c => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:57.402256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:57.405204 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.425061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce2e1-b9f1-4533-a547-f76edc3ae430 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:57.588493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:57.589759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01671e-c72c-42e8-a89a-0c83c875be71 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:57.592183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.594102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.595363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] PATH_INFO: `/v3/users/731b765267f9442bb483fd53d4c6770e` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.599754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731b765267f9442bb483fd53d4c6770e)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:57.607962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:57.619201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:57.619934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.620228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.621477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.622234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:57.624405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:57.669420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 889/1790] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:57.675134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:57.677828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.830095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102266-4a50-4790-99ff-ca5607c1b627 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:57.836946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:57.837897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.838624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.839299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.841606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.865897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:57.869413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff4ff-718a-46d2-965f-d9b0cdf6b640 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:57.884212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 890/1791] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:57.898803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:57.898803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:57.898803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:57.919542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731b765267f9442bb483fd53d4c6770e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.922175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731b765267f9442bb483fd53d4c6770e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.930066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:57.931370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:57.946764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731b765267f9442bb483fd53d4c6770e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.966031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 891/1792] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:57.966279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731b765267f9442bb483fd53d4c6770e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:57.970158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:57.970158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:58.000387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7cec7-5b3d-4958-8fcc-961362a29b43 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:58.021268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:58.023418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.023732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.027575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] PATH_INFO: `/v3/projects/cec53b5ba7b84ce588cb2ef608284afd/users/fcba1cefb7234ad5affffaf6596a5be9/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.058492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec53b5ba7b84ce588cb2ef608284afd, user_id=fcba1cefb7234ad5affffaf6596a5be9, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:58.068291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39fb5f-eac7-4219-a33a-a31e77c532e9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:58.072163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731b765267f9442bb483fd53d4c6770e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:19:58.088828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 902/1793] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:19:57 2022] DELETE /identity/v3/users/731b765267f9442bb483fd53d4c6770e => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:58.090965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:58.093699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:58.202274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 892/1794] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:57 2022] PUT /identity/v3/projects/cec53b5ba7b84ce588cb2ef608284afd/users/fcba1cefb7234ad5affffaf6596a5be9/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:58.202473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.205447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.205823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.239761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:58.242195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:58.278333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd373ee-6ad9-431f-af42-ca218978ee41 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:58.373379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 893/1795] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:58.374715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:58.398711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740983b-22c0-4fc7-af7c-b1788c633c00 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:58.414975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:58.415754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.416137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.416996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.417890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:58.419968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:58.432643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:58.434269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.435741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.436704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.446064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 894/1796] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:19:58.447448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:58.457580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:58.461329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:58.476705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 903/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:58.477598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031125b-59df-4331-bfda-7f309eb1f2fa admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:58.484646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:58.493334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:58.493985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.495815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.496103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.510063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36843-c311-450e-bde0-27f5838e3592 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:58.526562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:58.528174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.528607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.529212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] PATH_INFO: `/v3/projects/cec53b5ba7b84ce588cb2ef608284afd/users/fcba1cefb7234ad5affffaf6596a5be9/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.532552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:58.536197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec53b5ba7b84ce588cb2ef608284afd, user_id=fcba1cefb7234ad5affffaf6596a5be9, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:58.539309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:58.542659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c3fdf-060d-4063-b42e-80d5b5fdea53 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:58.579241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 904/1798] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:19:58 2022] PUT /identity/v3/projects/cec53b5ba7b84ce588cb2ef608284afd/users/fcba1cefb7234ad5affffaf6596a5be9/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:19:58.593485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:58.594042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:58.594267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:58.597098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 895/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:58.671544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] MFA Rules not processed for user `fcba1cefb7234ad5affffaf6596a5be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:19:58.673131 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:58.831528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 905/1800] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:19:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:19:58.849172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:58.850874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:59.019024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc078-73a0-4907-857f-edc5c32b6d3d service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:59.305295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:59.307596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:59.308118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:59.308665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:59.315562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:59.375692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:19:59.377456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:19:59.510828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:59.512665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:19:59.535525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 896/1801] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:19:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:19:59.694313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bab2b-777c-4a78-9025-ecc33e728584 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:19:59.733597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:19:59.743940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:19:59.745470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:19:59.746952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] PATH_INFO: `/v3/projects/1ada3ab7d3414a1c8af1371d096cfe7e` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:19:59.757173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ada3ab7d3414a1c8af1371d096cfe7e)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:19:59.769719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:00.018310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ada3ab7d3414a1c8af1371d096cfe7e', 'request_id': 'req-13189517-68d8-42d9-b1e2-95f8c4591f97'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.033982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ada3ab7d3414a1c8af1371d096cfe7e', 'request_id': 'req-13189517-68d8-42d9-b1e2-95f8c4591f97'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.128149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ada3ab7d3414a1c8af1371d096cfe7e', 'request_id': 'req-13189517-68d8-42d9-b1e2-95f8c4591f97'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.150256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] The token cache is being invalidate because project 1ada3ab7d3414a1c8af1371d096cfe7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:00.150552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.155804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.166263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 906/1802] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:19:59 2022] DELETE /identity/v3/projects/1ada3ab7d3414a1c8af1371d096cfe7e => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:00.169210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:00.201109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265150b7-83d5-40b0-abca-3eff3a5184b1 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:00.323736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:00.341366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:00.341366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:00.341366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] PATH_INFO: `/v3/users/f1c4fbb52ba94ee4862a075a4654c464` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:00.341366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c4fbb52ba94ee4862a075a4654c464)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:00.341366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:00.442853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:00.442853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:00.463438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189517-68d8-42d9-b1e2-95f8c4591f97 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:00.470152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:00.471654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:00.472260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:00.472917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] PATH_INFO: `/v3/projects/dae3ec6e1bb94e06aac221239c087db0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:00.475969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae3ec6e1bb94e06aac221239c087db0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:00.479083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:00.763432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c4fbb52ba94ee4862a075a4654c464'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.792512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae3ec6e1bb94e06aac221239c087db0', 'request_id': 'req-e101dfdf-3441-4516-974e-7bcdc231faa3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.797288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c4fbb52ba94ee4862a075a4654c464'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.813560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae3ec6e1bb94e06aac221239c087db0', 'request_id': 'req-e101dfdf-3441-4516-974e-7bcdc231faa3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.859688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c4fbb52ba94ee4862a075a4654c464'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.904784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae3ec6e1bb94e06aac221239c087db0', 'request_id': 'req-e101dfdf-3441-4516-974e-7bcdc231faa3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.932316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] The token cache is being invalidate because project dae3ec6e1bb94e06aac221239c087db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:00.932799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.933671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:00.944086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 907/1803] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:00 2022] DELETE /identity/v3/projects/dae3ec6e1bb94e06aac221239c087db0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:00.953398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:00.953398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:01.035737 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c4fbb52ba94ee4862a075a4654c464'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.037223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c4fbb52ba94ee4862a075a4654c464'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.051389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 897/1804] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:00 2022] DELETE /identity/v3/users/f1c4fbb52ba94ee4862a075a4654c464 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:01.058750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:01.060477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:01.157696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101dfdf-3441-4516-974e-7bcdc231faa3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:01.262390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a0e4-5ba8-431d-8923-a77e65b3d0ac admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:01.265863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:01.266569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:01.267154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:01.268021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] PATH_INFO: `/v3/projects/b56e01fefb0f455cbd6704cd189dbacf` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:01.270202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56e01fefb0f455cbd6704cd189dbacf)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:01.272198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:01.317793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:01.321238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:01.326830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:01.327826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] PATH_INFO: `/v3/users/28ec743aef384f4c9263f212c509b860` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:01.334648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ec743aef384f4c9263f212c509b860)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:01.337556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:01.428419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56e01fefb0f455cbd6704cd189dbacf', 'request_id': 'req-667e8875-427d-4126-85cb-f29c6720c468'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.443129 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56e01fefb0f455cbd6704cd189dbacf', 'request_id': 'req-667e8875-427d-4126-85cb-f29c6720c468'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.561515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ec743aef384f4c9263f212c509b860'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.564452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56e01fefb0f455cbd6704cd189dbacf', 'request_id': 'req-667e8875-427d-4126-85cb-f29c6720c468'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.581937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ec743aef384f4c9263f212c509b860'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.603385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] The token cache is being invalidate because project b56e01fefb0f455cbd6704cd189dbacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:01.603700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.604652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.606407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 908/1805] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:00 2022] DELETE /identity/v3/projects/b56e01fefb0f455cbd6704cd189dbacf => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:01.614932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:01.617445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:01.620215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ec743aef384f4c9263f212c509b860'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.699115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ec743aef384f4c9263f212c509b860'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.700169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ec743aef384f4c9263f212c509b860'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:01.711514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 898/1806] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:01 2022] DELETE /identity/v3/users/28ec743aef384f4c9263f212c509b860 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:01.735919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8875-427d-4126-85cb-f29c6720c468 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:01.819694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:01.821455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:01.821895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:01.822313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] PATH_INFO: `/v3/users/e1030b0cdd1049688d95316b4638f643` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:01.823759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1030b0cdd1049688d95316b4638f643)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:01.825847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:02.073468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1030b0cdd1049688d95316b4638f643'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.074556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1030b0cdd1049688d95316b4638f643'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.085611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1030b0cdd1049688d95316b4638f643'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.109393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:02.114429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:02.114536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1030b0cdd1049688d95316b4638f643'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.145427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc4ed-4b10-4a49-85fe-66524910dd03 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:02.156151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:02.158333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.163431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.165087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] PATH_INFO: `/v3/projects/e096116e227840fc9f9d130be3673c26` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.171954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e096116e227840fc9f9d130be3673c26)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:02.174817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:02.191589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b63f8608-90db-4680-b8fa-678d1293e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1030b0cdd1049688d95316b4638f643'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.199980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 909/1807] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:01 2022] DELETE /identity/v3/users/e1030b0cdd1049688d95316b4638f643 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:02.373039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e096116e227840fc9f9d130be3673c26', 'request_id': 'req-17cff345-0014-41d3-a493-8ea8e26aa7a5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.387135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e096116e227840fc9f9d130be3673c26', 'request_id': 'req-17cff345-0014-41d3-a493-8ea8e26aa7a5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.485867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e096116e227840fc9f9d130be3673c26', 'request_id': 'req-17cff345-0014-41d3-a493-8ea8e26aa7a5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.509912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] The token cache is being invalidate because project e096116e227840fc9f9d130be3673c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:02.510263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.516976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-17cff345-0014-41d3-a493-8ea8e26aa7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:02.526446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 899/1808] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:02 2022] DELETE /identity/v3/projects/e096116e227840fc9f9d130be3673c26 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:02.527191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.528023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.528558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.554999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:02.556106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:02.636001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 910/1809] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:02.643574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.643867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.644141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.689310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:02.690700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:02.701084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 900/1810] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:02.705256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:02.718169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee22f6-9629-45e1-a48f-6fdece3e638a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:02.731881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:02.733122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.733573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.733998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.734882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:02.735338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:02.751024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:02.751024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:02.751879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb35bba-74d1-4af0-8d18-23fcf9bc6159 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:02.789709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd34272-47e2-4028-9c66-86370e0ce517 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:02.814808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:02.814808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.814808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.814808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] PATH_INFO: `/v3/projects/0f78c9ea648646ce836bcef521289f21` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.815620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f78c9ea648646ce836bcef521289f21)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:02.824627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:02.828360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 911/1811] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:02.830800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2851d-94e4-43ee-9371-51da4cd4fcb1 None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.831584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2851d-94e4-43ee-9371-51da4cd4fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.832018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2851d-94e4-43ee-9371-51da4cd4fcb1 None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.836045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 912/1812] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:20:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:20:02.837002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2851d-94e4-43ee-9371-51da4cd4fcb1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:02.852914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2851d-94e4-43ee-9371-51da4cd4fcb1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:02.861556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:02.862482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:02.862944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:02.863364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:02.864261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:02.867675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fbc97-5f7a-471d-9568-cafecaa9b1dc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.033145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 913/1813] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:02 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:03.035495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64d99-4094-41e9-8b97-4172c05d7c1b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.035940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64d99-4094-41e9-8b97-4172c05d7c1b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.036378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64d99-4094-41e9-8b97-4172c05d7c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.050542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f78c9ea648646ce836bcef521289f21', 'request_id': 'req-482c63c3-13f1-41ad-b5e4-920b16e871e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.068103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f78c9ea648646ce836bcef521289f21', 'request_id': 'req-482c63c3-13f1-41ad-b5e4-920b16e871e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.077780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c7a64d99-4094-41e9-8b97-4172c05d7c1b None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:03.080339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c7a64d99-4094-41e9-8b97-4172c05d7c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.139005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f78c9ea648646ce836bcef521289f21', 'request_id': 'req-482c63c3-13f1-41ad-b5e4-920b16e871e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.158186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] The token cache is being invalidate because project 0f78c9ea648646ce836bcef521289f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:03.158684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.159812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.162599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 901/1814] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:02 2022] DELETE /identity/v3/projects/0f78c9ea648646ce836bcef521289f21 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:03.166709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.169197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.270744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 914/1815] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:03.272309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.273210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.273210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.275953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c63c3-13f1-41ad-b5e4-920b16e871e9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.294989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:03.296292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.366295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.369736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.370360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.370647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.371684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.374343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 915/1816] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:03.375643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.377977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.381278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.400927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc3768-1bcc-4d9d-a9f4-de93084d62a2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.417132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.417795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.418144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.418487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.434116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.435815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99402fb9-af99-4ccb-8f49-961e7231e103 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.448590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 916/1817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:03.449742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.450034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.450314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.499134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 902/1818] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/users => generated 292 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:03.500870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.527024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:03.528294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.542145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94150ea6-5cb3-4ef4-bc01-7e089c6d427e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.551294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.551294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.551498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.551655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.552368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.554100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 917/1819] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:03.556033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.560414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.561632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:03.576472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 903/1820] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:03.577786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.587271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70ba1f-f38f-4e6e-bc4f-3ea4a6f3a6a4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.593296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.594323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.594663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.594953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] PATH_INFO: `/v3/users/7b9f3baca64f4e4a9639ffdb3f95aba1` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.596379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9f3baca64f4e4a9639ffdb3f95aba1)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.598919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.603242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b4c6-e514-4aa3-9989-c09619f66d1d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.614973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.616302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.618773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.619140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.620134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:03.621970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.635917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.651278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 904/1821] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:03.652455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.665076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383223f-1e93-4ce1-8a3c-013042ed77f4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.670741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.671444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.671751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.672035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.672779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.674504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.688462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 905/1822] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:03.688462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.699399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837956-fdc0-433e-a949-5eb2db2f2d36 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.704566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.705243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.705527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.706759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.707685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.710247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.825831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 906/1823] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:03.825831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.860286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9f3baca64f4e4a9639ffdb3f95aba1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.861301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9f3baca64f4e4a9639ffdb3f95aba1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.868529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9f3baca64f4e4a9639ffdb3f95aba1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.885884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9f3baca64f4e4a9639ffdb3f95aba1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.908156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8036e0-069d-4b35-90f7-07b81aaa5217 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:03.914260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:03.915460 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:03.915793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:03.916119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] PATH_INFO: `/v3/projects/bd4e72acebe749928895c389abc6a1ed/users/ba18fe5762ea421489a1839d5b01aa5c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:03.931797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e72acebe749928895c389abc6a1ed, user_id=ba18fe5762ea421489a1839d5b01aa5c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:03.934605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94858de-dae4-4435-b6e9-f028f2c3a5e0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:03.973483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9f3baca64f4e4a9639ffdb3f95aba1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:03.983625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 918/1824] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:03 2022] DELETE /identity/v3/users/7b9f3baca64f4e4a9639ffdb3f95aba1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:03.984794 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:03.987746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.008347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 907/1825] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:03 2022] PUT /identity/v3/projects/bd4e72acebe749928895c389abc6a1ed/users/ba18fe5762ea421489a1839d5b01aa5c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:04.012046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667800-972d-43db-9233-b8c5b3d42b26 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.012046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667800-972d-43db-9233-b8c5b3d42b26 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.012046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667800-972d-43db-9233-b8c5b3d42b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.044920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e0667800-972d-43db-9233-b8c5b3d42b26 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:04.046191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e0667800-972d-43db-9233-b8c5b3d42b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.131508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5aeae-3968-4513-9e92-51fd090a8425 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.217004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 908/1826] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:04.219705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.220167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.220597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.276226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] MFA Rules not processed for user `ba18fe5762ea421489a1839d5b01aa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:04.277711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.322103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.322103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.322400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.324158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.325887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.330467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.422154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 909/1827] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:04.424235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.429372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 919/1828] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:03 2022] POST /identity/v3/users => generated 293 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:04.429372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.430453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.434234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.456063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a6bb-8ea9-4de0-8a5f-cf82ac481847 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.464747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.465773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.466892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.467640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.468559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.471799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.549464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f4935-87eb-4b64-b5c3-049ea62cc204 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.555533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.556947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.558053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.558337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.566093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 920/1829] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:04 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:04.566093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.572816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.575140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.587120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 910/1830] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:04.588114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.589480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:04.604502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ded97-1971-4c52-8eb3-d94e1065d486 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.669026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184b9c-eaa5-4073-a3a5-614e9b2edbea admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.676960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.678337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.678719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.679422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.680294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.682354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.685307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.686280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.686753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.687039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] PATH_INFO: `/v3/projects/ee027526a7044a72aafd1f9b017979ab` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.688469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee027526a7044a72aafd1f9b017979ab)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.692981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.697558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 921/1831] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:04.699159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.713477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf6495-2b08-46ab-9cc7-0dd4faa44b08 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.719725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.721146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.722022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.722927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.723672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.727266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.839372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 922/1832] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:04 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:04.839372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.844580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee027526a7044a72aafd1f9b017979ab', 'request_id': 'req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:04.857751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc24b-5b4e-4e95-82c0-d81a17857bc5 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:04.860767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee027526a7044a72aafd1f9b017979ab', 'request_id': 'req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:04.960487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:04.961656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:04.962009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:04.962275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:04.963878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:04.965333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:04.979764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 923/1833] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:04.980907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:04.990729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee027526a7044a72aafd1f9b017979ab', 'request_id': 'req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:05.002765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe58a-7cda-4c5f-90df-e0b9d528899b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.016874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] The token cache is being invalidate because project ee027526a7044a72aafd1f9b017979ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:05.017282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:05.020263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:05.026341 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 911/1834] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:04 2022] DELETE /identity/v3/projects/ee027526a7044a72aafd1f9b017979ab => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:05.027445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.040504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.040825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.040825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.040825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.040825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.045397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.045397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45d3a9-2b64-4a90-8205-f262f11daa02 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.059333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4cfa-3e0b-4a97-bbbc-a597f251aff2 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.072113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.074075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.074465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.074748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] PATH_INFO: `/v3/projects/20a51f15ce644e8cad584bdda38d4767/users/afc94ce9045145a6959e990c07c13b64/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.080649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 924/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:05.086176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.086787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.087327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.126586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:05.128173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.134580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a51f15ce644e8cad584bdda38d4767, user_id=afc94ce9045145a6959e990c07c13b64, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.139773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db4a34-e9f6-4edf-b026-da9e8a6319f6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.141249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 925/1836] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:05.143152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.149296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.165774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d96c0-7b24-4f83-9582-e46e41de9a26 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.171425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.172573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.173018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.173509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] PATH_INFO: `/v3/projects/eb680dc6683e44dcbefed427c2889ff0/users/f165072aabcb4809b06697d5d65945bb/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.200424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb680dc6683e44dcbefed427c2889ff0, user_id=f165072aabcb4809b06697d5d65945bb, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.203321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df58b5-2f9d-49ed-96df-ffaf3b907f87 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.244957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 912/1837] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:05 2022] PUT /identity/v3/projects/20a51f15ce644e8cad584bdda38d4767/users/afc94ce9045145a6959e990c07c13b64/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:05.246894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.247389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.247948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.295066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 926/1838] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:05 2022] PUT /identity/v3/projects/eb680dc6683e44dcbefed427c2889ff0/users/f165072aabcb4809b06697d5d65945bb/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:05.296509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.296805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.297081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.310367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:05.311984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.352877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] MFA Rules not processed for user `afc94ce9045145a6959e990c07c13b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:05.354209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.417149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 913/1839] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:05.417817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.436069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae823b7-1f4f-4da0-a0cc-fde043b4fa3b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.442159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.443462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.443777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.444053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.445318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.447344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.459167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 927/1840] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:05.459167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.468502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 914/1841] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:05.469520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.471558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d13ad-0a56-4ea7-af74-15c7e1319ca7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.479655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.480496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.480788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.481054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.481837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:05.482294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.484024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.484310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e17a9-a2d4-4e17-ab85-a4be02181f29 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.491642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.492583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.492931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.493149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.494188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.497264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392152-2c58-4a77-b4ea-60ee4730b22e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.500285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 928/1842] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:05.501175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.515365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698d63-db43-4576-b9a9-5b22700363d1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.530331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.530331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.530331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.530331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] PATH_INFO: `/v3/projects/eb680dc6683e44dcbefed427c2889ff0/users/f165072aabcb4809b06697d5d65945bb/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.530595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb680dc6683e44dcbefed427c2889ff0, user_id=f165072aabcb4809b06697d5d65945bb, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.530595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.542161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 929/1843] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:05 2022] PUT /identity/v3/projects/eb680dc6683e44dcbefed427c2889ff0/users/f165072aabcb4809b06697d5d65945bb/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:05.543135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:05.653998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c76b14-86b8-4df5-b619-6bb3b6f2157a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:05.658805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:05.659496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.659785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.660059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.660759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:05.664456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:05.788457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 915/1844] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:05.789897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:05.790295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:05.790670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:05.839944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] MFA Rules not processed for user `f165072aabcb4809b06697d5d65945bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:05.842599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:05.940484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 916/1845] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:05.941469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.017051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07df45-262e-4fe8-be8f-8dff287ecd5c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.030924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.031795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.032084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.032619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.033508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.035529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.497093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 917/1846] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/users => generated 299 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:06.499449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 930/1847] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:05 2022] POST /identity/v3/projects => generated 363 bytes in 954 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:06.501036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.503343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.504707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:06.570323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3323-250c-4aef-8599-7947ecbae966 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.578822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde1f68-30bf-48c2-b801-a3fb2ceaeb6e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.586710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.587411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.587972 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.588237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.589229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.592313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.610956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 931/1848] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:06.612194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.628241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c280b-060f-4929-899c-a472a96bf508 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.635207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.636368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.640830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.640830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.640830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.640830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.647167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.648222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.648517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.648849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.743502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 932/1849] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:06 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:06.745898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.750340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:06.762655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.765286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.779574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ada5-1fb3-4575-922f-5452f8f4e6fa admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.781452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 918/1850] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:06.782653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.789120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.790241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.793474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.793474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] PATH_INFO: `/v3/projects/b33a11c39976441e83abed16286bacb3` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.793474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33a11c39976441e83abed16286bacb3)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.796063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.798180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e133b-321f-414d-97a2-96584187f4e1 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:06.804853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:06.806320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:06.806755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:06.807228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] PATH_INFO: `/v3/projects/5c832b51535349b5b77b538dc89a18c9/users/831ab9648a214a66b28f078cb1c91670/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:06.838326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c832b51535349b5b77b538dc89a18c9, user_id=831ab9648a214a66b28f078cb1c91670, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:06.843290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:06.959280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 919/1851] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:06 2022] PUT /identity/v3/projects/5c832b51535349b5b77b538dc89a18c9/users/831ab9648a214a66b28f078cb1c91670/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:06.963425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:06.972483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33a11c39976441e83abed16286bacb3', 'request_id': 'req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:06.981855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33a11c39976441e83abed16286bacb3', 'request_id': 'req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.069921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596faa5a-8478-4fbf-9b80-aa80969cd8ea admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.070111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33a11c39976441e83abed16286bacb3', 'request_id': 'req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.092943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] The token cache is being invalidate because project b33a11c39976441e83abed16286bacb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:07.093820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.093956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.095931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 933/1852] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:06 2022] DELETE /identity/v3/projects/b33a11c39976441e83abed16286bacb3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:07.096728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.098067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.160384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.161082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.161371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.161651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.162967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.164642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.177275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 920/1853] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:07.177477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.179848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.195701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0f2d-82c9-4b97-8043-2025255afe5e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.202134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.202832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.203121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.203404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.204185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.205467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac467fe-bbc4-4f56-9e0a-db349e3f3edb admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.206805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.210335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.211326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.212472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.212617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.214915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.229846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 921/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:07.229846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.232994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.249820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952c851-7ce8-4df4-8145-5e0e456033ec admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.255120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.255669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.255958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.256239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] PATH_INFO: `/v3/users/fcba1cefb7234ad5affffaf6596a5be9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.257486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcba1cefb7234ad5affffaf6596a5be9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.259615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.288621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.290213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.301891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 934/1855] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:07.302978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.304515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.327436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55992-0f80-49ff-aa9c-a01c1ff19b4e service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.330855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.331891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.332189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.332615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.333364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.336017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.351116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 935/1856] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:07.352014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.368277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2f6e-acfc-44c3-b29f-87fba8dea60b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.373926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.375102 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.375463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.375851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] PATH_INFO: `/v3/projects/5c832b51535349b5b77b538dc89a18c9/users/831ab9648a214a66b28f078cb1c91670/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.384273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c832b51535349b5b77b538dc89a18c9, user_id=831ab9648a214a66b28f078cb1c91670, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.388232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.406273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 936/1857] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:07 2022] PUT /identity/v3/projects/5c832b51535349b5b77b538dc89a18c9/users/831ab9648a214a66b28f078cb1c91670/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:07.407315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.460390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcba1cefb7234ad5affffaf6596a5be9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.476471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcba1cefb7234ad5affffaf6596a5be9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.502515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcba1cefb7234ad5affffaf6596a5be9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.560098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8f09d-1c7e-4ded-a820-fc4329000e56 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:07.566194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:07.567346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.567639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcba1cefb7234ad5affffaf6596a5be9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.567967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.569052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] PATH_INFO: `/v3/projects/0e543934e65c455993283cf209447ee8/users/27e1008c243d41fbbbba94d20451a6f1/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.569272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1d07186b-6f20-46d8-b826-0d591927af6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcba1cefb7234ad5affffaf6596a5be9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:07.588912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 922/1858] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:07 2022] DELETE /identity/v3/users/fcba1cefb7234ad5affffaf6596a5be9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:07.588912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.588912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.588912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.606800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e543934e65c455993283cf209447ee8, user_id=27e1008c243d41fbbbba94d20451a6f1, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:07.619692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461932f9-c2de-421e-826d-6ac1b699b413 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:07.653061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] MFA Rules not processed for user `831ab9648a214a66b28f078cb1c91670`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:07.657342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.690438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 937/1859] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:07 2022] PUT /identity/v3/projects/0e543934e65c455993283cf209447ee8/users/27e1008c243d41fbbbba94d20451a6f1/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:07.701178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:07.701542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:07.701919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:07.763425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] MFA Rules not processed for user `27e1008c243d41fbbbba94d20451a6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:07.765307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.845855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 923/1860] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:07.856723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.858733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:07.916530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 938/1861] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:07.924675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:07.932750 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:08.004295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9e66e-9cd4-48eb-8e5e-3e09b2f9bdb6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.024625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de97fee-ab1f-4a96-9fef-4e0bc884fe95 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.030860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.031729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.032015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.032818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.033528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.049734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.088365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.088564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.088836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.089113 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.172696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 939/1862] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:07 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:08.182938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.184272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.191287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.237156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 924/1863] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:08.334582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbcde3-51b6-422a-b643-6fd5eab24869 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.339923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.340761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.341142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.341511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.342439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.349910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.434491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 940/1864] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:08 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:08.440859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.451654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a59f7-7197-40f5-ad9d-a1f8a1ca225e service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.457168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.457927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.458278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.458629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.459612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.461432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.476689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 925/1865] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:08.477962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.489460 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.492023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:08.495238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc23ca-ffdd-46db-ad19-2bcd2227dfdf admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.506419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ffb2-904b-4820-993f-e899e0d948bb admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.511093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.511680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.512005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.512289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.512657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] PATH_INFO: `/v3/projects/cec53b5ba7b84ce588cb2ef608284afd` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.513300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.513727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.513888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec53b5ba7b84ce588cb2ef608284afd)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.514294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] PATH_INFO: `/v3/projects/27e123e01b8645a5a03ae4998727ea7e/users/95380322ab264448980a6692f8e150b5/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.515827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.539500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e123e01b8645a5a03ae4998727ea7e, user_id=95380322ab264448980a6692f8e150b5, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.542401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.630129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec53b5ba7b84ce588cb2ef608284afd', 'request_id': 'req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:08.634456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 941/1866] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:08 2022] PUT /identity/v3/projects/27e123e01b8645a5a03ae4998727ea7e/users/95380322ab264448980a6692f8e150b5/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:08.641190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.650587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec53b5ba7b84ce588cb2ef608284afd', 'request_id': 'req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:08.734558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec53b5ba7b84ce588cb2ef608284afd', 'request_id': 'req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:08.766524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938abbf-14af-4599-806d-f53e328ce0f8 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.770555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] The token cache is being invalidate because project cec53b5ba7b84ce588cb2ef608284afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:08.770859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:08.772726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8b04c963-4fc4-4f74-9bb2-6ed5d92b7be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:08.778277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 926/1867] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:08 2022] DELETE /identity/v3/projects/cec53b5ba7b84ce588cb2ef608284afd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:08.782193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba849-40c8-467c-887f-fec32aa80dc2 None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.783503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba849-40c8-467c-887f-fec32aa80dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.784042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba849-40c8-467c-887f-fec32aa80dc2 None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.798281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 927/1868] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:20:08 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:20:08.802122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.803568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.804059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.841774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:08.843004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:08.890370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.891078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.891333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.891651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.892363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.893939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f701bf0-7641-446b-8c28-daa5d13dddfa admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.904956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 942/1869] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:08.906234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48487-87d7-4641-a6db-8a57779c2fc5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.906520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48487-87d7-4641-a6db-8a57779c2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.906796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48487-87d7-4641-a6db-8a57779c2fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.907237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 928/1870] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:08.910916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:08.913838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:08.926649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2fa48487-87d7-4641-a6db-8a57779c2fc5 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:08.927944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2fa48487-87d7-4641-a6db-8a57779c2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:08.928297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc739-679d-427f-bac0-29cfc6b941dc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:08.933409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:08.934305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.934587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.934863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] PATH_INFO: `/v3/projects/27e123e01b8645a5a03ae4998727ea7e/users/95380322ab264448980a6692f8e150b5/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.936855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e123e01b8645a5a03ae4998727ea7e, user_id=95380322ab264448980a6692f8e150b5, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:08.939611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf686a-fa44-47bf-a510-e2befe8f46ba admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:08.952425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 929/1871] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:08 2022] PUT /identity/v3/projects/27e123e01b8645a5a03ae4998727ea7e/users/95380322ab264448980a6692f8e150b5/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:08.953760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:08.954047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:08.954316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:08.974224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:08.985452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.062097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 943/1872] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:09.063709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.064009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.064293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.067555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 930/1873] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:09.072613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.087841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4237-37eb-4597-b1e9-f95cdec32c73 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.101909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.101909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.101909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.101909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.102395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:09.102395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.102395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.115274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 931/1874] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:20:09.115555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] MFA Rules not processed for user `95380322ab264448980a6692f8e150b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:09.116406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.117526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.118874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.218806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf657478-7f84-464c-ac39-0afe12c40c6e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.231016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.231016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.231590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.232565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.242285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 944/1875] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:09.242285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.251067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.253223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.255253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bac2a-c7da-480d-8ecb-b518820e3c4d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.270636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.270636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.270636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.270636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.272000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.273812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.274807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 932/1876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:09.275551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.277114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.347767 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ebc0c-f0f6-4625-abb4-c4e4ca422f30 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.354112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.354710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.354994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.355274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.367270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.368826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.369912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 945/1877] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:09 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:09.379535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 933/1878] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:09.380051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.440959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600dcf9-b19a-499b-8f1d-0a05b7fed7bf admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.446672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.447338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.447662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.447940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.448627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.450532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.550083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 946/1879] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:09 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:09.554850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.565112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440182ee-4ff9-48f3-8ce8-528609ef60e1 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.570556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.571226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.571547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.571827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.572552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.574178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.584327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 934/1880] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:09.589988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.599778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952362e4-58b6-490e-804c-e29faa4e9d88 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.604473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.605076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.605357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.605628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.606342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.607946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.618265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 947/1881] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:09.624486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.634917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795f3a-97a2-4990-9134-98c8f301b48f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.639546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.640416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.640700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.640978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] PATH_INFO: `/v3/projects/630d4bd739df4f4187e5bfae0b98c7d4/users/d297173f4a7c4c3597c54bf8149e2676/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.656154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630d4bd739df4f4187e5bfae0b98c7d4, user_id=d297173f4a7c4c3597c54bf8149e2676, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.658345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee8d7-de19-4a73-a320-52050a66be11 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.692565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.695117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.749615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 935/1882] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:09 2022] PUT /identity/v3/projects/630d4bd739df4f4187e5bfae0b98c7d4/users/d297173f4a7c4c3597c54bf8149e2676/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:09.757192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ab35-b4ab-469b-816a-881674351caf admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.760407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.760692 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.761000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.791980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] MFA Rules not processed for user `d297173f4a7c4c3597c54bf8149e2676`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:09.793661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.811436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.812355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.812643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.812922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.814836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.868181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 936/1883] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:09.868181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.872556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:09.908111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.910401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.932864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 948/1884] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:09.933841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:09.952474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8715ee1-5cfb-4eb3-88ee-7c5b5ffe6f7a service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.957577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.958242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.958524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.958837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.973332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.973695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fef2d-02c1-4503-81db-d9593f17d8f9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:09.975379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c292f0c-64ac-4048-ba87-9e79eef96cd2 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.985819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:09.987287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:09.987287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:09.988376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] PATH_INFO: `/v3/users/afc94ce9045145a6959e990c07c13b64` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:09.994196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc94ce9045145a6959e990c07c13b64)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:09.995302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:09.995824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 949/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:10.194163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc94ce9045145a6959e990c07c13b64'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:10.201438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc94ce9045145a6959e990c07c13b64'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:10.215089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc94ce9045145a6959e990c07c13b64'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:10.275180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc94ce9045145a6959e990c07c13b64'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:10.275850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc94ce9045145a6959e990c07c13b64'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:10.282279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 937/1886] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:09 2022] DELETE /identity/v3/users/afc94ce9045145a6959e990c07c13b64 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:10.287697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:10.287989 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:10.288265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:10.306599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:10.307964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:10.374268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 950/1887] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:10.383506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:10.385625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:10.524550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd651963-719c-49a8-a589-706d4043204b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:10.540229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:10.541281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:10.542138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:10.542559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:10.555613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:10.558117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2adbe-d148-4b22-b459-b32e1dfa30cd service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:10.573050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 938/1888] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:10.853080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:10.854557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:10.867057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9952c0-ea74-4220-9d7d-f2d648d4a5e0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:10.871776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:10.872652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:10.872933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:10.873207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] PATH_INFO: `/v3/users/ba18fe5762ea421489a1839d5b01aa5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:10.875050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba18fe5762ea421489a1839d5b01aa5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:10.876354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:11.032870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba18fe5762ea421489a1839d5b01aa5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.033640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba18fe5762ea421489a1839d5b01aa5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.041214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba18fe5762ea421489a1839d5b01aa5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.056221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba18fe5762ea421489a1839d5b01aa5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.160956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba18fe5762ea421489a1839d5b01aa5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.168307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 951/1889] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:10 2022] DELETE /identity/v3/users/ba18fe5762ea421489a1839d5b01aa5c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:11.175509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:11.175680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:11.176884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:11.201988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:11.203368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:11.274242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 939/1890] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:11.284236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:11.285650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:11.343534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5510f-8742-4528-a9a0-c5180e3f3389 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:11.347300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:11.348003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:11.348280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:11.348557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:11.359060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:11.360771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:11.371994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 952/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:11.827973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:11.830328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:11.843237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c715fe-bd80-49b9-a6cf-d9f97e7eebbc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:11.858308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:11.863058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:11.863058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:11.863058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] PATH_INFO: `/v3/projects/20a51f15ce644e8cad584bdda38d4767` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:11.863058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a51f15ce644e8cad584bdda38d4767)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:11.865799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:11.974259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:11.976189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:11.987115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a51f15ce644e8cad584bdda38d4767', 'request_id': 'req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:11.991133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e954-e560-47a3-8a17-cdf08cf528c6 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:11.994117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a51f15ce644e8cad584bdda38d4767', 'request_id': 'req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.051356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:12.052931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:12.053222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:12.053500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] PATH_INFO: `/v3/projects/bd4e72acebe749928895c389abc6a1ed` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:12.055189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4e72acebe749928895c389abc6a1ed)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:12.056961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:12.092480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a51f15ce644e8cad584bdda38d4767', 'request_id': 'req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.104918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] The token cache is being invalidate because project 20a51f15ce644e8cad584bdda38d4767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:12.105207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.105852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.107500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 940/1892] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:11 2022] DELETE /identity/v3/projects/20a51f15ce644e8cad584bdda38d4767 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:12.111296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:12.112636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:12.125766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18283a6-3a7f-40ac-9809-f1ba6d9ecd07 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:12.130463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:12.131301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:12.131620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:12.131894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] PATH_INFO: `/v3/users/831ab9648a214a66b28f078cb1c91670` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:12.133074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831ab9648a214a66b28f078cb1c91670)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:12.134984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:12.220980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4e72acebe749928895c389abc6a1ed', 'request_id': 'req-9d06f504-9d34-4880-b63e-c1af99ac6d0e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.229801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4e72acebe749928895c389abc6a1ed', 'request_id': 'req-9d06f504-9d34-4880-b63e-c1af99ac6d0e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.315865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4e72acebe749928895c389abc6a1ed', 'request_id': 'req-9d06f504-9d34-4880-b63e-c1af99ac6d0e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.338688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831ab9648a214a66b28f078cb1c91670'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.360227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831ab9648a214a66b28f078cb1c91670'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.370632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] The token cache is being invalidate because project bd4e72acebe749928895c389abc6a1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:12.372853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.375910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.381788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 953/1893] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:11 2022] DELETE /identity/v3/projects/bd4e72acebe749928895c389abc6a1ed => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:12.385940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:12.388888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:12.389244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831ab9648a214a66b28f078cb1c91670'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.497902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f504-9d34-4880-b63e-c1af99ac6d0e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:12.503770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831ab9648a214a66b28f078cb1c91670'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.504425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831ab9648a214a66b28f078cb1c91670'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.511594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 941/1894] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:12 2022] DELETE /identity/v3/users/831ab9648a214a66b28f078cb1c91670 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:12.526126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:12.527312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:12.527619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:12.528222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] PATH_INFO: `/v3/users/f165072aabcb4809b06697d5d65945bb` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:12.529237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f165072aabcb4809b06697d5d65945bb)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:12.531190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:12.739168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f165072aabcb4809b06697d5d65945bb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.740696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f165072aabcb4809b06697d5d65945bb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.748858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f165072aabcb4809b06697d5d65945bb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.769454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f165072aabcb4809b06697d5d65945bb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.847736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f165072aabcb4809b06697d5d65945bb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:12.866779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 954/1895] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:12 2022] DELETE /identity/v3/users/f165072aabcb4809b06697d5d65945bb => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:13.135072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.136679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.223078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dfd5b-c496-41d0-8666-f4846e7064f9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.290907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.291824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.292115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.292395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] PATH_INFO: `/v3/projects/5c832b51535349b5b77b538dc89a18c9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.293598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c832b51535349b5b77b538dc89a18c9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.295569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.334667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.336176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.352783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df393-ed2d-4863-a386-968b92766cd5 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.358013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.358987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.362418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.362418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] PATH_INFO: `/v3/projects/eb680dc6683e44dcbefed427c2889ff0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.362418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb680dc6683e44dcbefed427c2889ff0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.364351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.422788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c832b51535349b5b77b538dc89a18c9', 'request_id': 'req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.428391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c832b51535349b5b77b538dc89a18c9', 'request_id': 'req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.463231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb680dc6683e44dcbefed427c2889ff0', 'request_id': 'req-9a1b134a-b3a9-41db-beb8-e70915cccc39'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.469258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb680dc6683e44dcbefed427c2889ff0', 'request_id': 'req-9a1b134a-b3a9-41db-beb8-e70915cccc39'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.498412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c832b51535349b5b77b538dc89a18c9', 'request_id': 'req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.513024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] The token cache is being invalidate because project 5c832b51535349b5b77b538dc89a18c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:13.513326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.514060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1c21f8ca-0ebb-4ab2-b946-8962cfe7c41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.519256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 942/1896] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:13 2022] DELETE /identity/v3/projects/5c832b51535349b5b77b538dc89a18c9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:13.528645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d177e-07b9-4f5f-98f2-63c8c9f5e125 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.528936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d177e-07b9-4f5f-98f2-63c8c9f5e125 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.529211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d177e-07b9-4f5f-98f2-63c8c9f5e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.549686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb680dc6683e44dcbefed427c2889ff0', 'request_id': 'req-9a1b134a-b3a9-41db-beb8-e70915cccc39'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.559200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-376d177e-07b9-4f5f-98f2-63c8c9f5e125 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:13.560167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-376d177e-07b9-4f5f-98f2-63c8c9f5e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.565490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] The token cache is being invalidate because project eb680dc6683e44dcbefed427c2889ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:13.565796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.567718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9a1b134a-b3a9-41db-beb8-e70915cccc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:13.580149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 955/1897] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:13 2022] DELETE /identity/v3/projects/eb680dc6683e44dcbefed427c2889ff0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:13.584759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5ae7-d4ed-4d57-b150-8c1e775ef9da None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.585141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5ae7-d4ed-4d57-b150-8c1e775ef9da None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.585709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5ae7-d4ed-4d57-b150-8c1e775ef9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.612075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d75e5ae7-d4ed-4d57-b150-8c1e775ef9da None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:13.613541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d75e5ae7-d4ed-4d57-b150-8c1e775ef9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.677918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 943/1898] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:13.685454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.685760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.686246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.706521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:13.707750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.716882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 944/1899] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:13.721047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.726053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 956/1900] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:13.730923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6a53-0fbc-4a2c-89ba-2c037a4621f6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.736535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.736770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.737003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.737203 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.737364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.737525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.737768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.738504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:13.738952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.740676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.761511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 945/1901] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:20:13.767260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.767793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:13.768835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:13.781461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 957/1902] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:13.781656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044f8d-2a07-487a-a409-5c6b3cc71bf4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.783855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.784586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.784881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.788223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.788223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.788383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.788455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.795650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d7a1-8366-49ba-aa40-1949364804e5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.801613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.802315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.802603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.802882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.803646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:13.803955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.805558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.817683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 958/1903] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:13.823184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.832849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842da54-665a-45b6-9d6e-33f5c86163b9 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:13.838798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:13.839494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:13.839793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:13.840061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:13.845504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:13.845504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:13.900468 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 946/1904] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:13.905924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.940184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 959/1905] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:13.944990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:13.972071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a257-be6e-4b39-a41f-fd53b66ad9da admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.036292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8eedb-cfa4-4e73-9bf2-01fbd968c1bc admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.037783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.038211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.038842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.039221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.040193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.042721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.042981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.043068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.043202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.043499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.044870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.047246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.125399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 947/1906] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:14.131887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.135176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 960/1907] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:13 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:14.137541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.162562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5beba-765b-4c92-b24c-93c2dbcac5b8 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.175056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b6d-97ab-4292-82bc-b0c1035b9908 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.178571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.179641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.180469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.181224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.183454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.187952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.188792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.190955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.191394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.191834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.195203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.199041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.214806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 961/1908] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:14.215965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.219213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:14.219396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 948/1909] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:14.220595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.244105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a87e-d16e-45ab-858c-b2611e2bead3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.259710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.260430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.260719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.260998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.261736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.263344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.265277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f2621-e18a-4749-ad8a-bcdc84a7749d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.281551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.282442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.282714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.282999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] PATH_INFO: `/v3/users/d297173f4a7c4c3597c54bf8149e2676` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.284265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d297173f4a7c4c3597c54bf8149e2676)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.286415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.288242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 949/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:14.289766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.307856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d9225-62f9-46f9-b5d8-42eb6242a28a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.315016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.316647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.317547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.317873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.318619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.320333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.332325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 950/1911] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:14.333195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.345936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccee3f-2ea0-408a-ab73-e494a6bfeca1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.361068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.362004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.362326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.362562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] PATH_INFO: `/v3/projects/58c80a73b9de4e1899bd63983f49b55c/users/0609f2e6f69e464dabbf696a64896b77/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.384978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c80a73b9de4e1899bd63983f49b55c, user_id=0609f2e6f69e464dabbf696a64896b77, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.387513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.467161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd297173f4a7c4c3597c54bf8149e2676'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:14.468206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd297173f4a7c4c3597c54bf8149e2676'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:14.475803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd297173f4a7c4c3597c54bf8149e2676'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:14.487222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd297173f4a7c4c3597c54bf8149e2676'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:14.504170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 951/1912] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:14 2022] PUT /identity/v3/projects/58c80a73b9de4e1899bd63983f49b55c/users/0609f2e6f69e464dabbf696a64896b77/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:14.507808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.509182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:14.555658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-859f48ea-3d72-4c83-ac6d-994bd6741bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd297173f4a7c4c3597c54bf8149e2676'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:14.562418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 962/1913] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:14 2022] DELETE /identity/v3/users/d297173f4a7c4c3597c54bf8149e2676 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:14.564313 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f991d-8bd0-4fb1-86ac-d9c100edcd9c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.564907 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f991d-8bd0-4fb1-86ac-d9c100edcd9c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.565481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f991d-8bd0-4fb1-86ac-d9c100edcd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.585293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-310f991d-8bd0-4fb1-86ac-d9c100edcd9c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:14.587566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-310f991d-8bd0-4fb1-86ac-d9c100edcd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:14.598012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9f43-dc25-4f50-bd28-5c421194df10 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.654923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 963/1914] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:14.655825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.656145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.656371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.662756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.663688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.663972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.664247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] PATH_INFO: `/v3/projects/998cfc2342044950badbecd8558b12a5/users/e3a1d86e3d55409d87d3bfd0b349b6ad/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.676331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:14.677705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:14.682078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998cfc2342044950badbecd8558b12a5, user_id=e3a1d86e3d55409d87d3bfd0b349b6ad, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.685098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.686492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 964/1915] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:14.688310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.689631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:14.761803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 952/1916] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:14 2022] PUT /identity/v3/projects/998cfc2342044950badbecd8558b12a5/users/e3a1d86e3d55409d87d3bfd0b349b6ad/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:14.763438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:14.764875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24472daa-5226-4b81-a8a5-782789a1755e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.853081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.853927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.854520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.854876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.870115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099e03-2d74-4d4f-a45f-e048b60783d5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:14.875142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:14.876163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:14.877050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:14.877050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:14.997015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:14.998666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:14.999153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.000787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98965522-e654-46ab-a928-e64c8c887160 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.012205 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 965/1917] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:15.013362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.013647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.013920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.030744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 953/1918] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:15.047952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] MFA Rules not processed for user `e3a1d86e3d55409d87d3bfd0b349b6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:15.047952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.116033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 966/1919] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:15.120722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.132660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2b58-aa6f-477a-9167-4e14b432cecc service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.137761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.138422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.138702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.138973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.139733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.141981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.228663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 954/1920] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:15.230412 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.242450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9521fc5-e957-4448-91d6-deace015edd8 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.299035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.303926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.303926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.303926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.303926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.303926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.421407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.427758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 967/1921] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:15.435760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63cd4f-021b-4c0d-b23e-28e74ddab3bc admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.442824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.447584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.447584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.447584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.447584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.447584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.461991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 955/1922] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:15.467798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.478570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f78318-6128-4338-a88e-ed4532b2954e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.483317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.484234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.484518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.484794 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] PATH_INFO: `/v3/projects/ea2aa9ec57e047de8e08fb3639897702/users/8897e3db2197412db4cb8a89ddacdee6/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.499846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2aa9ec57e047de8e08fb3639897702, user_id=8897e3db2197412db4cb8a89ddacdee6, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.502495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.578070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 968/1923] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:15 2022] PUT /identity/v3/projects/ea2aa9ec57e047de8e08fb3639897702/users/8897e3db2197412db4cb8a89ddacdee6/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:15.578213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.580627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.580889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.606496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abafcca-28e9-4f4a-b61b-47037cbb95ab admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.667013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1427b-af2a-45ae-b7a3-5b0994b0082a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.672411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.673092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.673383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.673698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.674456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.676265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.681392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.681392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.681392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.681688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] PATH_INFO: `/v3/projects/630d4bd739df4f4187e5bfae0b98c7d4` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.682728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630d4bd739df4f4187e5bfae0b98c7d4)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.684658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.687618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 969/1924] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:15.691413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.709369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4965-1d05-4a98-9391-4b810488e86f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.714329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.715221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.715537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.715872 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] PATH_INFO: `/v3/projects/ea2aa9ec57e047de8e08fb3639897702/users/8897e3db2197412db4cb8a89ddacdee6/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.717917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2aa9ec57e047de8e08fb3639897702, user_id=8897e3db2197412db4cb8a89ddacdee6, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.720611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d6875-3295-423f-8f41-d4177f15e9b7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.731426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 970/1925] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:15 2022] PUT /identity/v3/projects/ea2aa9ec57e047de8e08fb3639897702/users/8897e3db2197412db4cb8a89ddacdee6/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:15.743225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c141-25d0-4cac-a50f-fe13aa3186a7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.743548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c141-25d0-4cac-a50f-fe13aa3186a7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.743833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c141-25d0-4cac-a50f-fe13aa3186a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.772977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-52a2c141-25d0-4cac-a50f-fe13aa3186a7 None None] MFA Rules not processed for user `8897e3db2197412db4cb8a89ddacdee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:15.774540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-52a2c141-25d0-4cac-a50f-fe13aa3186a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.786987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630d4bd739df4f4187e5bfae0b98c7d4', 'request_id': 'req-9e01aac2-f031-4257-962e-ea94a81f5815'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:15.792593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630d4bd739df4f4187e5bfae0b98c7d4', 'request_id': 'req-9e01aac2-f031-4257-962e-ea94a81f5815'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:15.841031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630d4bd739df4f4187e5bfae0b98c7d4', 'request_id': 'req-9e01aac2-f031-4257-962e-ea94a81f5815'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:15.854464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] The token cache is being invalidate because project 630d4bd739df4f4187e5bfae0b98c7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:15.854754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:15.855626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 971/1926] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:15.856063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:15.858100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 956/1927] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:15 2022] DELETE /identity/v3/projects/630d4bd739df4f4187e5bfae0b98c7d4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:15.864167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdc35-57b1-4a27-9bac-4a618d403009 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.865438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdc35-57b1-4a27-9bac-4a618d403009 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.865739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdc35-57b1-4a27-9bac-4a618d403009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.866842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:15.868288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.884411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-222cdc35-57b1-4a27-9bac-4a618d403009 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:15.885620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-222cdc35-57b1-4a27-9bac-4a618d403009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.926870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01aac2-f031-4257-962e-ea94a81f5815 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:15.932962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:15.933785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.934070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.934357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.936318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:15.949061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 972/1928] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:15.958000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:15.959006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:15.959301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:15.959618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:15.959719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:15.970834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 957/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:15.986397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:15.986581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.004437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.011650 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 973/1930] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:16.019807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807cb1-2700-46b4-8a66-ae983bb5d453 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.025769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.028942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.028942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.028942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.028942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:16.028942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.030434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.049663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.062804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 958/1931] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:16.070077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019da4-76ab-4145-aa3d-f11faf4e67bc None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.076902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.077582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.077861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.078174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.078834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.080935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.212613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.214448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.229658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 974/1932] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/projects => generated 399 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:16.233677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.235746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab45962-a23e-438e-b37e-ab92911ec6c9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.300360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.300618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.300899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.301583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.303379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.310158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a72ad-df96-458c-bb3b-48b08a154f84 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.319226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.320432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.320432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.320652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.321249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.323245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.377188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.379017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05d6cf-8cd9-4427-92f3-c25752cb5b21 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.389849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 959/1933] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:16.412759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.412759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.412759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.434360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 975/1934] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:16.438363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.441808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] MFA Rules not processed for user `0609f2e6f69e464dabbf696a64896b77`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:16.443063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.451966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3baa-3527-4412-9ffe-175ee6e69d0b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.457213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.457980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.458919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.462948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.462948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.462948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.473716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 976/1935] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:16.477995 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.488799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cd56-e835-4007-b215-fb3b7be4d633 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.493940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.494692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.495032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.496742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.496742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.497955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.511046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 977/1936] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:16.515299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.521664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 960/1937] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:16.526484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e73a6d-fca6-43d2-9710-0cf4e54e9885 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.530768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.532335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.538303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.538303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.538303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.538303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] PATH_INFO: `/v3/projects/5b7a4bb05f524f60b7d374319b8c011e/users/51f4bbdfca2741709092ab6510db1bdd/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.545944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b93af-ddc0-404e-aad5-5937a57828c8 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.550827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.551502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.551800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.552285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.553084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.563291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7a4bb05f524f60b7d374319b8c011e, user_id=51f4bbdfca2741709092ab6510db1bdd, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.563388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.563533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fd7b3-0fea-42a6-8fc2-e3f986f8cd09 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.641062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 978/1938] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:16 2022] PUT /identity/v3/projects/5b7a4bb05f524f60b7d374319b8c011e/users/51f4bbdfca2741709092ab6510db1bdd/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:16.652332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.655778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.655778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.667733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 961/1939] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:16.668711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.678113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] MFA Rules not processed for user `51f4bbdfca2741709092ab6510db1bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:16.679378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.732963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f530fe-6093-4a0c-af0e-ccf920eb285a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.738224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.738901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.739189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.739465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.740195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.742139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.746912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 979/1940] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:16.758777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.811884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c2019-cb2f-4753-9a95-e9860b28b823 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.815572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.816220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.816519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.816822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.825431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.826855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.836115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 980/1941] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:16.841625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 962/1942] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:16 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:16.845358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.855538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4ac2-f708-4a65-9dda-6152756b4114 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.862868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.863340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.863652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.863926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.865159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.866735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.882957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 981/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:16.884418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.891726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:16.893357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:16.895664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5b09-409c-41bc-b9c4-c514366bd87b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.900486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.901456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.902086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.902872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] PATH_INFO: `/v3/projects/d40338386cb1497ebcbdb31412984820/users/baf86fbd036c444699da5b6f27c945fe/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.907231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96eec8-81b4-419a-a927-73b838412afa admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:16.912386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:16.913341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:16.913628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:16.913906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] PATH_INFO: `/v3/users/e3a1d86e3d55409d87d3bfd0b349b6ad` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:16.915227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a1d86e3d55409d87d3bfd0b349b6ad)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.917324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:16.919672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40338386cb1497ebcbdb31412984820, user_id=baf86fbd036c444699da5b6f27c945fe, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:16.923192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:17.013786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 963/1944] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:16 2022] PUT /identity/v3/projects/d40338386cb1497ebcbdb31412984820/users/baf86fbd036c444699da5b6f27c945fe/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:17.017923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:17.083847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d80ad-6c9a-4271-b287-274233728018 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:17.089029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:17.089711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:17.089990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:17.090268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:17.092677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:17.092677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:17.103685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 964/1945] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:17.107712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:17.119887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a22de8-b6fa-4504-9f3c-53a524f7394d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:17.127493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:17.127493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:17.127493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:17.127493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] PATH_INFO: `/v3/projects/d40338386cb1497ebcbdb31412984820/users/baf86fbd036c444699da5b6f27c945fe/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:17.129026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40338386cb1497ebcbdb31412984820, user_id=baf86fbd036c444699da5b6f27c945fe, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:17.132382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40bb3b-ee7c-4237-b718-a342b9d23d36 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:17.136208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a1d86e3d55409d87d3bfd0b349b6ad'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:17.137329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a1d86e3d55409d87d3bfd0b349b6ad'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:17.156079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 965/1946] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:17 2022] PUT /identity/v3/projects/d40338386cb1497ebcbdb31412984820/users/baf86fbd036c444699da5b6f27c945fe/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:17.156211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a1d86e3d55409d87d3bfd0b349b6ad'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:17.193754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a1d86e3d55409d87d3bfd0b349b6ad'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:17.258147 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a1d86e3d55409d87d3bfd0b349b6ad'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:17.268555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 982/1947] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:16 2022] DELETE /identity/v3/users/e3a1d86e3d55409d87d3bfd0b349b6ad => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:17.274637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:17.275119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:17.275299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:17.312503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:17.314144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:17.392636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 966/1948] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:17.411327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:17.413473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:17.498732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f222b3e-2e96-47ab-b9a3-9239168dade0 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:17.503148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:17.503855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:17.504331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:17.504609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:17.515366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:17.516954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:17.527911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 983/1949] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:18.193376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:18.195120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:18.213154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae55e-6482-40df-b546-842f9ce901ff None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:18.217973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:18.218874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:18.219297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:18.219610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] PATH_INFO: `/v3/projects/998cfc2342044950badbecd8558b12a5` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:18.220863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998cfc2342044950badbecd8558b12a5)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:18.222955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:18.332239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998cfc2342044950badbecd8558b12a5', 'request_id': 'req-3e23c08f-926e-4070-a2f8-1e2efdaec345'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.338247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998cfc2342044950badbecd8558b12a5', 'request_id': 'req-3e23c08f-926e-4070-a2f8-1e2efdaec345'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.446992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998cfc2342044950badbecd8558b12a5', 'request_id': 'req-3e23c08f-926e-4070-a2f8-1e2efdaec345'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.469742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] The token cache is being invalidate because project 998cfc2342044950badbecd8558b12a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:18.470033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.470691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3e23c08f-926e-4070-a2f8-1e2efdaec345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.472498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 967/1950] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:18 2022] DELETE /identity/v3/projects/998cfc2342044950badbecd8558b12a5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:18.476622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:18.486701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca17d-192e-44ee-97aa-f39e82cf4ebf service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:18.570614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:18.571662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:18.571949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:18.572228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] PATH_INFO: `/v3/users/8897e3db2197412db4cb8a89ddacdee6` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:18.573563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8897e3db2197412db4cb8a89ddacdee6)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:18.575587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:18.759046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:18.760292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:18.760874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:18.805710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8897e3db2197412db4cb8a89ddacdee6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.807812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8897e3db2197412db4cb8a89ddacdee6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.823427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8897e3db2197412db4cb8a89ddacdee6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.834395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] MFA Rules not processed for user `baf86fbd036c444699da5b6f27c945fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:18.835731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:18.850846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8897e3db2197412db4cb8a89ddacdee6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.945564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 968/1951] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:18.952370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8897e3db2197412db4cb8a89ddacdee6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:18.964212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 984/1952] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:18 2022] DELETE /identity/v3/users/8897e3db2197412db4cb8a89ddacdee6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:18.985776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:18.988162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:19.060628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20507adf-c16c-459f-b0e4-c7ea901ac6e5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:19.124819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:19.125483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:19.125765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:19.126045 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:19.127826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:19.196486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:19.198028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d149c-916d-497b-a883-49910a1c838b service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:19.208030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 969/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:19.477253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:19.478667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:19.568345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5e49-d85e-4cb3-a5f1-5414262c959d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:19.582307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:19.582307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:19.582307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:19.582307 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] PATH_INFO: `/v3/projects/ea2aa9ec57e047de8e08fb3639897702` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:19.583022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2aa9ec57e047de8e08fb3639897702)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:19.583022 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:19.732373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2aa9ec57e047de8e08fb3639897702', 'request_id': 'req-22baeeaf-979e-4bd9-bd16-6c69145ae793'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:19.738147 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2aa9ec57e047de8e08fb3639897702', 'request_id': 'req-22baeeaf-979e-4bd9-bd16-6c69145ae793'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:19.832015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2aa9ec57e047de8e08fb3639897702', 'request_id': 'req-22baeeaf-979e-4bd9-bd16-6c69145ae793'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:19.848446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] The token cache is being invalidate because project ea2aa9ec57e047de8e08fb3639897702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:19.848811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:19.849436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-22baeeaf-979e-4bd9-bd16-6c69145ae793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:19.851140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 985/1954] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:19 2022] DELETE /identity/v3/projects/ea2aa9ec57e047de8e08fb3639897702 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:19.857640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:19.857640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:19.857640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:19.886762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:19.886762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:19.950728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 970/1955] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:19.958973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:19.959463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:19.959905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:19.980939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:19.982155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:19.991029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 986/1956] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:19.995359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.005875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544457ff-fde5-4f77-8abc-f65527e8e2b6 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.010653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.011630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.011997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.012284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.013021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:20.013334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.014974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.027916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 971/1957] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:20.032520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.042130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da451d8e-157e-4753-9a68-d8d85e17ffe3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.046980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.050704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.050704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.050704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.050704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.051138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.137359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 987/1958] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:20 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:20.140179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.151484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d55b6e-87c4-46c1-8410-44ab3b4fa415 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.222459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.223259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.223586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.224117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.225028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.227147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.327059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 972/1959] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:20 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:20.331290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.341398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94535b-5873-4974-a28b-9168e1f07330 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.345961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.346612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.346894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.347169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.347931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.350090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.360465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 988/1960] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:20.365001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.374517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65355c-8c1f-4fce-b04f-ea0ea308b144 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.379146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.381998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.381998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.381998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.381998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.382739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ac98-af32-4d06-b3cf-489b7d3013cc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.392298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 973/1961] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:20.396339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.406266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ead0f-162e-45b0-a269-3ec8f6fb8731 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.410959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.412401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.416418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.416418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] PATH_INFO: `/v3/projects/fa479143f40749b0876ff5350ade596d/users/95a796977325418fb1ecd9c3d7bf5b82/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.427811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa479143f40749b0876ff5350ade596d, user_id=95a796977325418fb1ecd9c3d7bf5b82, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.430415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.514285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 989/1962] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:20 2022] PUT /identity/v3/projects/fa479143f40749b0876ff5350ade596d/users/95a796977325418fb1ecd9c3d7bf5b82/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:20.525834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.526125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.526408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.553316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] MFA Rules not processed for user `95a796977325418fb1ecd9c3d7bf5b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:20.554507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:20.615251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 974/1963] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:20.619785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.687352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5059cbf-3034-40c1-909f-dbf6ed7c510b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.691964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.692617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.692902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.693278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.694084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.695994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.780264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 990/1964] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:20 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:20.784539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.795813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75484e7-c09b-473a-b440-42fd0f83cf7d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.850451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.851177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.851459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.851768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.852454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.854604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.921287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 975/1965] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:20 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:20.926014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.938087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91e9b4-7dfa-47be-8cc4-c55ff3b2ace1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.946455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.946455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.946455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.946455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:20.946749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:20.947617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:20.963788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 991/1966] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:20.965572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:20.977108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae3bc3-85f0-4cb5-bb47-c79faa59556c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:20.983626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:20.984539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:20.984827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:20.985099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] PATH_INFO: `/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e/users/9c68fe506f0f47478eaaceab5181d613/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:21.000936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b226da7ced5429f8fa937c1d29c0e9e, user_id=9c68fe506f0f47478eaaceab5181d613, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:21.003706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:21.093140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 976/1967] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:20 2022] PUT /identity/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e/users/9c68fe506f0f47478eaaceab5181d613/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:21.097441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:21.107451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ec89-48cf-4c5d-9f96-9e8c166cbd0a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:21.163026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:21.163731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:21.164012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:21.164283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:21.165002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:21.166591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3ee11-c132-4bb4-a919-9d98b07e359f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:21.176436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 992/1968] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:21.181461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:21.191596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e709-a3d6-47c4-8193-7502c770ba0b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:21.196899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:21.197782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:21.198060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:21.198333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] PATH_INFO: `/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e/users/9c68fe506f0f47478eaaceab5181d613/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:21.200389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b226da7ced5429f8fa937c1d29c0e9e, user_id=9c68fe506f0f47478eaaceab5181d613, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:21.202979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:21.213987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 977/1969] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:21 2022] PUT /identity/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e/users/9c68fe506f0f47478eaaceab5181d613/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:21.224203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:21.224489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:21.224767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:21.260481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] MFA Rules not processed for user `9c68fe506f0f47478eaaceab5181d613`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:21.261720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:21.328359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 993/1970] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:21.340012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:21.341747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:21.398492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1eedb-362c-42cd-ac36-9f2db9abf4cc admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:21.402522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:21.403200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:21.403512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:21.403798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:21.457394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:21.459365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:21.467985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 978/1971] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:23.368132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:23.378625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328810cc-44c9-4e60-b8f4-d59938849cc3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:23.385557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:23.386277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:23.386565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:23.386895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:23.388789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:23.452508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:23.454053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470b77a-921c-4b1a-9658-7bda78e218d9 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:23.464970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 994/1972] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:24.430534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:24.432313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:24.500499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0959c-69ee-4ec2-929c-7f4df0adcc90 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:24.509199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:24.509199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:24.509199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:24.509199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] PATH_INFO: `/v3/users/27e1008c243d41fbbbba94d20451a6f1` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:24.509549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e1008c243d41fbbbba94d20451a6f1)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:24.509984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:24.698968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e1008c243d41fbbbba94d20451a6f1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:24.705705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e1008c243d41fbbbba94d20451a6f1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:24.722097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e1008c243d41fbbbba94d20451a6f1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:24.800712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e1008c243d41fbbbba94d20451a6f1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:24.801526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e1008c243d41fbbbba94d20451a6f1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:24.807761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 979/1973] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:24 2022] DELETE /identity/v3/users/27e1008c243d41fbbbba94d20451a6f1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:24.812224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:24.812711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:24.812802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:24.834743 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:24.836187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:24.900556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 995/1974] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:24.910474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:24.912143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:24.978068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc3594-f44a-42a7-81e6-11a2d875fcf5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:24.989503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:24.989705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:24.989991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:24.990270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:24.999841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:25.001414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:25.011984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 980/1975] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:25.516277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:25.518352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:25.534986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ee4c9-3594-4266-a2d5-0caa563d9857 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:25.540618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:25.544366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:25.544366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:25.544366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] PATH_INFO: `/v3/projects/0e543934e65c455993283cf209447ee8` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:25.544366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e543934e65c455993283cf209447ee8)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:25.545591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:25.712923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e543934e65c455993283cf209447ee8', 'request_id': 'req-8c147622-dd12-4fab-a500-6d44234fb053'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:25.719882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e543934e65c455993283cf209447ee8', 'request_id': 'req-8c147622-dd12-4fab-a500-6d44234fb053'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:25.801402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e543934e65c455993283cf209447ee8', 'request_id': 'req-8c147622-dd12-4fab-a500-6d44234fb053'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:25.814646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] The token cache is being invalidate because project 0e543934e65c455993283cf209447ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:25.815311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:25.815590 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:25.817275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 996/1976] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:25 2022] DELETE /identity/v3/projects/0e543934e65c455993283cf209447ee8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:25.821198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:25.830678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d19ed5-4454-48f7-895d-51027a3e31b5 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:25.893267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:25.894154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:25.894477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:25.894757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] PATH_INFO: `/v3/users/95380322ab264448980a6692f8e150b5` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:25.896714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95380322ab264448980a6692f8e150b5)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:25.898620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:26.091627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95380322ab264448980a6692f8e150b5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.098475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95380322ab264448980a6692f8e150b5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.110724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95380322ab264448980a6692f8e150b5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.172669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95380322ab264448980a6692f8e150b5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.173452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95380322ab264448980a6692f8e150b5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.180818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 981/1977] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:25 2022] DELETE /identity/v3/users/95380322ab264448980a6692f8e150b5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:26.551757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:26.554699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:26.567926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c147622-dd12-4fab-a500-6d44234fb053 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:26.577605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:26.579015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:26.677265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20da77-75e7-47cb-bb01-2098607ee124 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:26.686309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:26.687420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:26.688025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:26.688604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] PATH_INFO: `/v3/users/51f4bbdfca2741709092ab6510db1bdd` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:26.690198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f4bbdfca2741709092ab6510db1bdd)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:26.691086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:26.693816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:26.693935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:26.694188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:26.694474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] PATH_INFO: `/v3/projects/27e123e01b8645a5a03ae4998727ea7e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:26.704790 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e123e01b8645a5a03ae4998727ea7e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:26.707089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:26.880697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e123e01b8645a5a03ae4998727ea7e', 'request_id': 'req-6533fd70-1959-4d65-ad75-709af2d4a429'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.881964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f4bbdfca2741709092ab6510db1bdd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.882777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f4bbdfca2741709092ab6510db1bdd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.888268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e123e01b8645a5a03ae4998727ea7e', 'request_id': 'req-6533fd70-1959-4d65-ad75-709af2d4a429'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.891239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f4bbdfca2741709092ab6510db1bdd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.905152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f4bbdfca2741709092ab6510db1bdd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.978143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e123e01b8645a5a03ae4998727ea7e', 'request_id': 'req-6533fd70-1959-4d65-ad75-709af2d4a429'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.992976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] The token cache is being invalidate because project 27e123e01b8645a5a03ae4998727ea7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:26.993339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.994066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6533fd70-1959-4d65-ad75-709af2d4a429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:26.995902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 982/1978] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:26 2022] DELETE /identity/v3/projects/27e123e01b8645a5a03ae4998727ea7e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:27.000492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf566d2-060d-4eec-81c7-475462db39a7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.001033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf566d2-060d-4eec-81c7-475462db39a7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.001542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf566d2-060d-4eec-81c7-475462db39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.021065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ecf566d2-060d-4eec-81c7-475462db39a7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:27.022845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ecf566d2-060d-4eec-81c7-475462db39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.072099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d16f4870-1084-4eee-8bb8-6108be6b1576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f4bbdfca2741709092ab6510db1bdd'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:27.084826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 997/1979] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:26 2022] DELETE /identity/v3/users/51f4bbdfca2741709092ab6510db1bdd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:27.095698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 983/1980] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:27.097380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.097691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.100732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.104665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.104966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.105260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.124414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:27.125645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.129483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:27.131000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.219374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 984/1981] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:27.226806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.244591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3ad9-b2e6-4f20-83b9-4a94460822c5 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.263034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.263797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.264090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.264372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.265123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:27.265497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.267339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.284410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 985/1982] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:27.286522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.292207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 998/1983] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:27.297143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f25030-ce41-45e6-a173-be0e91074882 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.302454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.302719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.303392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.303816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.304100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.304766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.304881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.306716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.369600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08e04a-6f17-49be-aa17-60d100eafd9c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.373771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.374429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.374717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.375007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.384792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.386494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.397795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 999/1984] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:27.405485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 986/1985] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:27.409798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.421777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466574c-b436-414b-99e3-bc90dca765af service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.481767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.482757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.483115 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.483924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.484290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.486390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.568949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1000/1986] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:27.573612 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.586966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723cc7-47fe-46c7-b011-e976aa0f0e82 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.592611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.593631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.594092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.594466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.595301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.597130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.611607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 987/1987] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:27.613928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.625082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110df09-83c4-4934-b4db-8180907a337f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.631842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.633280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.633978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.634679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.635903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.638164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.661671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.665157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1001/1988] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:27.670071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b6ab-dc22-42e2-ac56-bb6b20fff457 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.679167 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.680912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.680912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.680912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] PATH_INFO: `/v3/projects/2ec05a9af62c48f880ada5c3caf863f1/users/147cf60b98274cc7998cc27908c7cc1e/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.702779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec05a9af62c48f880ada5c3caf863f1, user_id=147cf60b98274cc7998cc27908c7cc1e, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.705951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06452-e33b-4190-98bd-668f18291d71 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.724811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.726469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.789174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ef794-9d1f-4686-bd6a-466cbb042f1a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:27.795715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 988/1989] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:27 2022] PUT /identity/v3/projects/2ec05a9af62c48f880ada5c3caf863f1/users/147cf60b98274cc7998cc27908c7cc1e/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:27.806724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.807017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.807300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.842527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] MFA Rules not processed for user `147cf60b98274cc7998cc27908c7cc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:27.845515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.882487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:27.883149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:27.883651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:27.883935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:27.886394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:27.928934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 989/1990] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:27.931564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:27.960161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:27.961957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:27.973286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1002/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:28.035728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce471c7-8553-4c48-9cd4-43a17d5f9732 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.044272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.045762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.046150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.046567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.047670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.050225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.166325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 990/1992] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:27 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:28.167647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.180071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58e3a2-f80b-48d6-8549-320289998f51 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.258804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.262428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.262728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.263009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.263755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.265726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.374537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1003/1993] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:28 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:28.378564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.396126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bf03-563a-4c25-ae32-7939b5df4ae3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.415432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.416609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.417423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.417423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.418142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.419904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.437287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 991/1994] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:28.438458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.450987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271266-e0d0-4779-a42d-940e45f646d4 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.455846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.456770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.457077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.457355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] PATH_INFO: `/v3/projects/7281d1fe150443db9c601cc4303f4c83/users/5bf0a5dee7cd44d3bcb40ea0da02ba55/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.474642 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7281d1fe150443db9c601cc4303f4c83, user_id=5bf0a5dee7cd44d3bcb40ea0da02ba55, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.475540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.477615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.477759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:28.492795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ec2b-21bf-4051-93fe-4cccaa9bd530 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.498272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.499143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.499430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.499769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] PATH_INFO: `/v3/projects/5b7a4bb05f524f60b7d374319b8c011e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.500945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7a4bb05f524f60b7d374319b8c011e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.502886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.531723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1004/1995] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:28 2022] PUT /identity/v3/projects/7281d1fe150443db9c601cc4303f4c83/users/5bf0a5dee7cd44d3bcb40ea0da02ba55/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:28.533038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.604277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5275be-d4f9-4a2a-abd2-5c026ff74402 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.626108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7a4bb05f524f60b7d374319b8c011e', 'request_id': 'req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:28.640176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7a4bb05f524f60b7d374319b8c011e', 'request_id': 'req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:28.689727 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.690586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.690996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.691375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.692283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.694084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.704798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1005/1996] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:28.708724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.722173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ffc74-8b38-4673-ba84-021824a1fad2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.728127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.729119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.729528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.730108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] PATH_INFO: `/v3/projects/7281d1fe150443db9c601cc4303f4c83/users/5bf0a5dee7cd44d3bcb40ea0da02ba55/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.732618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7281d1fe150443db9c601cc4303f4c83, user_id=5bf0a5dee7cd44d3bcb40ea0da02ba55, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.736881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57540b06-a024-4168-8cb4-2300f05b95bc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:28.748544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1006/1997] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:28 2022] PUT /identity/v3/projects/7281d1fe150443db9c601cc4303f4c83/users/5bf0a5dee7cd44d3bcb40ea0da02ba55/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:28.759655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.759908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.760190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.766459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7a4bb05f524f60b7d374319b8c011e', 'request_id': 'req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:28.782298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] The token cache is being invalidate because project 5b7a4bb05f524f60b7d374319b8c011e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:28.783627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:28.792651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] MFA Rules not processed for user `5bf0a5dee7cd44d3bcb40ea0da02ba55`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:28.794242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:28.798388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f30571b8-e9cc-41c0-b0ed-4d3a7e6547c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:28.802344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 992/1998] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:28 2022] DELETE /identity/v3/projects/5b7a4bb05f524f60b7d374319b8c011e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:28.812130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13454f8-bc43-442b-a725-ecbdff40215c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.812436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13454f8-bc43-442b-a725-ecbdff40215c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.812720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13454f8-bc43-442b-a725-ecbdff40215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.835459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a13454f8-bc43-442b-a725-ecbdff40215c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:28.836696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a13454f8-bc43-442b-a725-ecbdff40215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:28.880281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1007/1999] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:28.891270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.893996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:28.915256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 993/2000] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:28.917680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.918084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.918461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.948793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:28.950114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:28.963580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 994/2001] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:28.966816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:28.980810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000e64d-7c6f-4d0a-9954-4d81fb1c910d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:28.993560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:28.994458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:28.994892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:28.995268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:28.996320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:28.996731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:28.998540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.003401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40790-5709-4c75-af2f-6f96e6995ffc None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.007222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.007914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.008199 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.008476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.010302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:29.013727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 995/2002] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:29.017584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.040974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c302-cd2b-4011-89b6-40dcb934bc58 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.048007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.048849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.049236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.049632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.051213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.052980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.076994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.080182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.099319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1008/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:20:29.169598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 996/2004] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:29 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:29.175692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.200772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ccd6-20fb-4a07-b9d6-c5dab1a32c53 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.260404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.261084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.261366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.261640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.262358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.264346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.374771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1009/2005] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:29 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:29.378960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.391905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1feaab-f4c7-45e9-ab36-cfc87b61ab09 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.398837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.401017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.401017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.401017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.402428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.404471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.417159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 997/2006] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:29.421117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.431678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafdd99-2807-47cd-8920-baa00e958136 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.436518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.437250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.437602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.437944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.438789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.440502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d0a38-96c4-462a-a1da-68a38847c947 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.454991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1010/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:29.456551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.467802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6226734-9625-41ee-a611-582ffe9215ad admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.472641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.473638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.473919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.479540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] PATH_INFO: `/v3/projects/b0a880bb2648415aa3ee1a89d71186f6/users/14313ce3f35f4468add7fbc073f90f12/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.489958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a880bb2648415aa3ee1a89d71186f6, user_id=14313ce3f35f4468add7fbc073f90f12, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.493033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.556361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 998/2008] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:29 2022] PUT /identity/v3/projects/b0a880bb2648415aa3ee1a89d71186f6/users/14313ce3f35f4468add7fbc073f90f12/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:29.562139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.562694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.563098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.587881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:29.589283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:29.658034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1011/2009] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:29.668557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:29.670958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:29.805869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bba9b7-b49d-4e02-9376-9358ad414c23 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:29.841462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:29.842139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:29.842428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:29.842714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:29.861685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:29.863144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:29.914399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 999/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:35.982929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:35.989790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:36.095222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7558ae0-fa7b-4019-9077-a580438a3861 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:36.099306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:36.100198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:36.100631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:36.101034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:36.250836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:36.265167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99c74c-107d-4601-a9be-52b60a39f6ed service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:36.298861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1012/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:36.399924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:36.402590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:36.428755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711615-94ea-4a5d-b857-996df9b6272c service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:36.440705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:36.445925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:36.445925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:36.445925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] PATH_INFO: `/v3/users/95a796977325418fb1ecd9c3d7bf5b82` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:36.447035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a796977325418fb1ecd9c3d7bf5b82)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:36.449811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:36.743251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a796977325418fb1ecd9c3d7bf5b82'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:36.762783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a796977325418fb1ecd9c3d7bf5b82'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:36.791657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a796977325418fb1ecd9c3d7bf5b82'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:36.870525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a796977325418fb1ecd9c3d7bf5b82'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:36.871418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-08086572-ff46-4d03-b643-16c7b2f96c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a796977325418fb1ecd9c3d7bf5b82'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:36.885303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1000/2012] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:36 2022] DELETE /identity/v3/users/95a796977325418fb1ecd9c3d7bf5b82 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:36.885801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:36.886097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:36.886374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:36.887822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:36.888125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:36.888457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:36.909957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:36.912312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:36.947978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] MFA Rules not processed for user `14313ce3f35f4468add7fbc073f90f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:36.949191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:37.005155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1013/2013] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:37.016380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.017805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:37.036906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1001/2014] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:37.041628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.043053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:37.057919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef3add-5ae4-4a37-a05f-886047b2d505 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.062736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.064845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.064845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.064845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.064845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.066805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.077152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce3626-adbe-470b-8ffa-1d779ad4e9f6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.081056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.081776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.081982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.082252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.091349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.092854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.103048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1014/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:37.163293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1002/2016] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:37 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:37.167551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.177974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e1dd1-7758-45c9-bdc8-6056ec3caded service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.245367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.246045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.246361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.246603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.247443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.249451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.326658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1015/2017] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:37 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:37.330904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.341943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9a16-458c-4018-8cdf-88ae6f6ee323 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.347576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.348253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.349316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.349561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.350293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.351917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.362648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1003/2018] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:37.367112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.377001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd6641-f85f-4fa9-9abc-74e35cfb7994 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.381844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.382798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.383086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.383361 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] PATH_INFO: `/v3/projects/5f3ae0753ba64adf8b508e63b2542414/users/cdd07436b7854da287ef51baac9231fd/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.398607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ae0753ba64adf8b508e63b2542414, user_id=cdd07436b7854da287ef51baac9231fd, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.401324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.515864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1016/2019] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:37 2022] PUT /identity/v3/projects/5f3ae0753ba64adf8b508e63b2542414/users/cdd07436b7854da287ef51baac9231fd/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:37.519964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.531382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2252-ccf2-4386-91b5-ef98119a23ac admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.589741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.591556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.591858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.592237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.592798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.596375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.612164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1004/2020] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:37.616597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.629004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15b74-eb10-4642-b943-50405b15b42c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:37.634485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:37.635576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:37.635879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:37.636233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] PATH_INFO: `/v3/projects/5f3ae0753ba64adf8b508e63b2542414/users/cdd07436b7854da287ef51baac9231fd/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:37.638454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ae0753ba64adf8b508e63b2542414, user_id=cdd07436b7854da287ef51baac9231fd, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:37.643003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:37.655570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1017/2021] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:37 2022] PUT /identity/v3/projects/5f3ae0753ba64adf8b508e63b2542414/users/cdd07436b7854da287ef51baac9231fd/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:37.820804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:37.823094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:37.882120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef9f-8639-4022-88d5-80924dc9b45b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:38.040439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:38.041704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:38.042165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:38.042643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] PATH_INFO: `/v3/projects/fa479143f40749b0876ff5350ade596d` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:38.044182 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa479143f40749b0876ff5350ade596d)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:38.046446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:38.235953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa479143f40749b0876ff5350ade596d', 'request_id': 'req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.241927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa479143f40749b0876ff5350ade596d', 'request_id': 'req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.335949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa479143f40749b0876ff5350ade596d', 'request_id': 'req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.369011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] The token cache is being invalidate because project fa479143f40749b0876ff5350ade596d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:38.369319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.372091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.374172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1005/2022] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:37 2022] DELETE /identity/v3/projects/fa479143f40749b0876ff5350ade596d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:38.377928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:38.379898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:38.392537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802616f0-1472-4fc9-b7b5-b2435fb19af2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:38.485709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:38.486870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:38.487459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:38.488008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] PATH_INFO: `/v3/users/9c68fe506f0f47478eaaceab5181d613` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:38.489916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c68fe506f0f47478eaaceab5181d613)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:38.491924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:38.695739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c68fe506f0f47478eaaceab5181d613'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.696400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c68fe506f0f47478eaaceab5181d613'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.704601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c68fe506f0f47478eaaceab5181d613'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.720438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c68fe506f0f47478eaaceab5181d613'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.789746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6891dd71-3ab5-44d6-961a-1ecc1818e19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c68fe506f0f47478eaaceab5181d613'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:38.796820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1018/2023] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:38 2022] DELETE /identity/v3/users/9c68fe506f0f47478eaaceab5181d613 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:39.194964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:39.218663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8ebe-6f49-47b6-9883-d8c3bf7f2bd5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:39.296974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:39.297858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:39.298146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:39.298428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] PATH_INFO: `/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:39.300613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b226da7ced5429f8fa937c1d29c0e9e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:39.303001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:39.435070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b226da7ced5429f8fa937c1d29c0e9e', 'request_id': 'req-b8b5902f-87e9-4126-b2f5-087a5fcbf844'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:39.441221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b226da7ced5429f8fa937c1d29c0e9e', 'request_id': 'req-b8b5902f-87e9-4126-b2f5-087a5fcbf844'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:39.494011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b226da7ced5429f8fa937c1d29c0e9e', 'request_id': 'req-b8b5902f-87e9-4126-b2f5-087a5fcbf844'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:39.513741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] The token cache is being invalidate because project 1b226da7ced5429f8fa937c1d29c0e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:39.514892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:39.516034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b8b5902f-87e9-4126-b2f5-087a5fcbf844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:39.518298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1006/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:39 2022] DELETE /identity/v3/projects/1b226da7ced5429f8fa937c1d29c0e9e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:39.524075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:39.524954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:39.525245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:39.568312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:39.568312 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:39.671127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1019/2025] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:39.686824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:39.687448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:39.688551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:39.721721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:39.723058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:39.732975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1007/2026] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:39.737393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:39.758198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ccfad-505a-47d2-89e8-23d0a6989f9f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:39.763646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:39.764375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:39.764689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:39.764965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:39.765694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:39.766002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:39.767885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:39.805162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1020/2027] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:20:39.809830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:39.820525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7909-dee3-4a11-b853-fcb4b23cb717 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:39.834698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:39.836248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:39.838521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:39.838923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:39.840369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:39.845443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:39.993608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:40.001278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1008/2028] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:40.005566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90613f-d7d4-4b40-bc29-8ccddad6f29b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:40.079680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:40.080477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.080854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.081329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.082112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:40.084187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:40.170636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1021/2029] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:39 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:40.175830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:40.203498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d9f1-d246-4780-a08d-52c16895cc4c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:40.209804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:40.210609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.210958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.211309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.212256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:40.213965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:40.225626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1009/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:40.229884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:40.241475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992dcd1-ce4c-4689-9c0e-ffd003bc6d54 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:40.250116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:40.250986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.251424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.251882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.252774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:40.254652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69807-90e1-456d-ac2f-4ce1de9f130b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:40.268927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1022/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:40.271083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:40.282746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0084-463e-44ef-8d99-80584c8407ca admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:40.288574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:40.289595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.289882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.293904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] PATH_INFO: `/v3/projects/d743a97328904c2e84d007d8babf9f3a/users/58226198ff89492ea55db6e894072651/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.306299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d743a97328904c2e84d007d8babf9f3a, user_id=58226198ff89492ea55db6e894072651, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:40.308983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:40.379422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1010/2032] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:40 2022] PUT /identity/v3/projects/d743a97328904c2e84d007d8babf9f3a/users/58226198ff89492ea55db6e894072651/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:40.391828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866ddb5-7b11-47ba-9596-5a08716780ab None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.392133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866ddb5-7b11-47ba-9596-5a08716780ab None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.392414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866ddb5-7b11-47ba-9596-5a08716780ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.476838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4866ddb5-7b11-47ba-9596-5a08716780ab None None] MFA Rules not processed for user `58226198ff89492ea55db6e894072651`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:40.482524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4866ddb5-7b11-47ba-9596-5a08716780ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:40.687758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1023/2033] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:40.709656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:40.711797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:40.823894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb98b9-5e1f-4873-9a8c-77a97fa607a3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:40.830286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:40.831337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:40.831938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:40.832367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:40.845179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:40.847454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:40.863266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1011/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:45.082029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:45.082600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:45.082600 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:45.112430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] MFA Rules not processed for user `cdd07436b7854da287ef51baac9231fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:45.114474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:45.185775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1024/2035] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:45.197026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:45.198456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:45.273316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720623-cd6a-4782-bf0c-9c1018da4995 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:45.279092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:45.279776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:45.280064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:45.280344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:45.282096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:45.338357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:45.340021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:45.349909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1012/2036] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:52.939990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:52.939990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:53.012970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1cce-fe89-4dbd-8925-2fce1b924be7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:53.017909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:53.018804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:53.019090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:53.019638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] PATH_INFO: `/v3/users/0609f2e6f69e464dabbf696a64896b77` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:53.020796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0609f2e6f69e464dabbf696a64896b77)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:53.022875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:53.198861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0609f2e6f69e464dabbf696a64896b77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.199611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0609f2e6f69e464dabbf696a64896b77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.206547 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0609f2e6f69e464dabbf696a64896b77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.218089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0609f2e6f69e464dabbf696a64896b77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.280345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0609f2e6f69e464dabbf696a64896b77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.287118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1025/2037] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:52 2022] DELETE /identity/v3/users/0609f2e6f69e464dabbf696a64896b77 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:53.510068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:53.520865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df407-fa43-435a-8821-c3acf9d18d78 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:53.576402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:53.577253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:53.577530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:53.577799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] PATH_INFO: `/v3/projects/58c80a73b9de4e1899bd63983f49b55c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:53.578965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c80a73b9de4e1899bd63983f49b55c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:53.580924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:53.684202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c80a73b9de4e1899bd63983f49b55c', 'request_id': 'req-b147eed0-4947-4287-a944-7acf3f51f3c4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.689419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c80a73b9de4e1899bd63983f49b55c', 'request_id': 'req-b147eed0-4947-4287-a944-7acf3f51f3c4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.748141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c80a73b9de4e1899bd63983f49b55c', 'request_id': 'req-b147eed0-4947-4287-a944-7acf3f51f3c4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.759512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] The token cache is being invalidate because project 58c80a73b9de4e1899bd63983f49b55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:53.759829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.760443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:53.763262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1013/2038] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:53 2022] DELETE /identity/v3/projects/58c80a73b9de4e1899bd63983f49b55c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:53.766035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:53.767465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:53.781055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea751b9-c15d-45c0-935d-490cc311a06b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:53.835396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:53.836279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:53.836561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:53.836830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] PATH_INFO: `/v3/users/baf86fbd036c444699da5b6f27c945fe` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:53.837985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf86fbd036c444699da5b6f27c945fe)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:53.839944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:54.027330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf86fbd036c444699da5b6f27c945fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.027979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf86fbd036c444699da5b6f27c945fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.034878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf86fbd036c444699da5b6f27c945fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.047904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf86fbd036c444699da5b6f27c945fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.115060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f3ccd40e-5c42-4d82-bbc5-70d5ae80abff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf86fbd036c444699da5b6f27c945fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.122033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1026/2039] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:53 2022] DELETE /identity/v3/users/baf86fbd036c444699da5b6f27c945fe => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:54.361642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:54.363075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:54.377049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147eed0-4947-4287-a944-7acf3f51f3c4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:54.435633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:54.436662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.436940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.437209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] PATH_INFO: `/v3/projects/d40338386cb1497ebcbdb31412984820` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.438491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40338386cb1497ebcbdb31412984820)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:54.442306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:54.544520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40338386cb1497ebcbdb31412984820', 'request_id': 'req-81a4c74d-6381-47ae-a906-74e9e593358e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.550939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40338386cb1497ebcbdb31412984820', 'request_id': 'req-81a4c74d-6381-47ae-a906-74e9e593358e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.618023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40338386cb1497ebcbdb31412984820', 'request_id': 'req-81a4c74d-6381-47ae-a906-74e9e593358e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.629751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] The token cache is being invalidate because project d40338386cb1497ebcbdb31412984820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:54.630036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.630735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-81a4c74d-6381-47ae-a906-74e9e593358e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:54.633100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1014/2040] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:54 2022] DELETE /identity/v3/projects/d40338386cb1497ebcbdb31412984820 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:54.638862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.639177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.639718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.657914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:54.659106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:54.716474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1027/2041] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:54.724409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.725243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.725516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.744422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:54.745593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:54.753568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1015/2042] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:54.758331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:54.767801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c31c9-3d49-4fc6-8400-406d35fec552 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:54.772324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:54.772973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.773254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.773531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.774248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:54.774554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:54.776188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:54.793298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1028/2043] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:54.797696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:54.808534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769f51-f895-46f3-b7fc-9337a55efbf4 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:54.813260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:54.813909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.814222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.814495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.815179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:54.817138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:54.922558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1016/2044] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:54 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:54.928709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:54.938859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6207a2-aa45-4829-a987-e280bdd3281d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:54.996044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:54.997060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:54.997353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:54.997639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:54.998342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:55.000295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:55.093401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1029/2045] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:54 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:55.097806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:55.109049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993e00b-66bc-4ac2-b295-0611213ac2f1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:55.113970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:55.114644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:55.114910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:55.115195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:55.116040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:55.117610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:55.138181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1017/2046] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:55.142143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:55.153756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b583f-a62a-4a18-b2e5-4d1221971bea admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:55.158798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:55.159777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:55.160386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:55.160866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:55.161806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:55.164201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a0091-0a10-426b-8378-e57e262e8862 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:55.175035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1030/2047] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:55.179141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:55.189680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a56ec-40b7-4de3-93cb-1883bac5aa43 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:55.201384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:55.202309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:55.202601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:55.202863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] PATH_INFO: `/v3/projects/9645324ae8ce4797bf3b3a1488580840/users/fa4c4b0fed5b4bb99f89b4728d5e29cc/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:55.219375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9645324ae8ce4797bf3b3a1488580840, user_id=fa4c4b0fed5b4bb99f89b4728d5e29cc, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:55.222058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:55.297702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1018/2048] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:55 2022] PUT /identity/v3/projects/9645324ae8ce4797bf3b3a1488580840/users/fa4c4b0fed5b4bb99f89b4728d5e29cc/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:55.307848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:55.308144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:55.308430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:55.335772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] MFA Rules not processed for user `fa4c4b0fed5b4bb99f89b4728d5e29cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:55.336913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:55.400357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1031/2049] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:55.411582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:55.414019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:55.468797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9af746-b419-4a2f-8f07-1487d160eb47 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:55.472749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:55.473401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:55.473680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:55.473966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:55.483235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:55.484712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:55.493594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1019/2050] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:57.214429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:57.215944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:57.291902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803caed-4e90-4a8a-b102-08b204436e99 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:57.296857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:57.302016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:57.302016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:57.302016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] PATH_INFO: `/v3/users/8c4029d4def64dc1b3c286400be2ab5c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:57.302016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c4029d4def64dc1b3c286400be2ab5c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:57.302016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:57.488305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c4029d4def64dc1b3c286400be2ab5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.488950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c4029d4def64dc1b3c286400be2ab5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.495876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c4029d4def64dc1b3c286400be2ab5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.507497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c4029d4def64dc1b3c286400be2ab5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.589413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c4029d4def64dc1b3c286400be2ab5c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.595971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1032/2051] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:57 2022] DELETE /identity/v3/users/8c4029d4def64dc1b3c286400be2ab5c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:57.645190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:57.647303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:57.663509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cc0a0-0425-4834-b331-519ac417031d service glance] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:57.725990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:57.726951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:57.727180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:57.727498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] PATH_INFO: `/v3/users/58226198ff89492ea55db6e894072651` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:57.728903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58226198ff89492ea55db6e894072651)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:57.730921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:57.876002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:57.877445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:57.894564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0797372-ddf0-416c-927b-dd3ad42a9667 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:57.902997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:57.904128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:57.904621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:57.905053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] PATH_INFO: `/v3/projects/dc8d333bbf1b4e438b6db5ca7092b582` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:57.907586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8d333bbf1b4e438b6db5ca7092b582)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:57.909596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:57.918538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58226198ff89492ea55db6e894072651'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.925928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58226198ff89492ea55db6e894072651'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:57.938704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58226198ff89492ea55db6e894072651'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.011717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58226198ff89492ea55db6e894072651'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.012347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-df9a5c28-6125-4509-8d23-6c351bd0ce5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58226198ff89492ea55db6e894072651'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.018919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1020/2052] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:20:57 2022] DELETE /identity/v3/users/58226198ff89492ea55db6e894072651 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:58.023982 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.024275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.024553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.043389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.044623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.057793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8d333bbf1b4e438b6db5ca7092b582', 'request_id': 'req-51273167-3d65-4a43-8f1e-ce343b122f25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.064728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8d333bbf1b4e438b6db5ca7092b582', 'request_id': 'req-51273167-3d65-4a43-8f1e-ce343b122f25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.104121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1021/2053] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:58.114329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.116556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.149067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8d333bbf1b4e438b6db5ca7092b582', 'request_id': 'req-51273167-3d65-4a43-8f1e-ce343b122f25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.160693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] The token cache is being invalidate because project dc8d333bbf1b4e438b6db5ca7092b582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:58.161011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.161626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-51273167-3d65-4a43-8f1e-ce343b122f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.163275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1033/2054] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:57 2022] DELETE /identity/v3/projects/dc8d333bbf1b4e438b6db5ca7092b582 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:58.169828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801f15-e773-41ac-820b-c28087074256 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.170459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801f15-e773-41ac-820b-c28087074256 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.170776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801f15-e773-41ac-820b-c28087074256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.174016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d1d05-b0b5-4620-9ec0-258647a4ed5f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.179017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.179705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.179987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.180259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.182224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.197210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.198683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab6f7-e95c-4156-8919-571d2105504a service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.205128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-09801f15-e773-41ac-820b-c28087074256 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.206323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-09801f15-e773-41ac-820b-c28087074256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.208730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1022/2055] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:58.215537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1034/2056] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:58.221747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.222056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.222332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.240776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.242015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.250419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1023/2057] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:58.254466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801f15-e773-41ac-820b-c28087074256 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.265105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801f15-e773-41ac-820b-c28087074256 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.270235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.270895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.271550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.271643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.272367 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:58.272675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.274542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.286793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1035/2058] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:20:58.291310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.301374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ba000-e34b-4f9b-9ba4-9e96bbb2887a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.310292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.310989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.311270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.311575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.312309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.314272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.375915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1024/2059] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:58.380110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.395046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293f03d-363c-41cf-a498-db90d4091922 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.477635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.478343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.478629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.478905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.479963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.483065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.572519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1036/2060] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:58.576490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.590423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca6e2-cec7-4cfa-994a-27f6a79ad397 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.598135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.601931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.614128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.615153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.616286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.617647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.617864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.619505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.621346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9db3f-93f1-4172-9422-925b756f0c18 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.627886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.628773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.629183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.629467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] PATH_INFO: `/v3/projects/d743a97328904c2e84d007d8babf9f3a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.630665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d743a97328904c2e84d007d8babf9f3a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.634809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1025/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:58.634961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.635901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.645585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6888-5fad-4c4c-bb87-b4ab7948a6e3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.650169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.650812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.651096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.651369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.652395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.653972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.665487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1026/2062] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:58.669342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.681531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6dffd-2832-4a94-a1e4-6c1ebb0dbfeb admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.686207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.687092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.687375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.687683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] PATH_INFO: `/v3/projects/facb67395c034cbab945c41bb2083cd8/users/8cc91ef925d247d58cb8dd9077efaee3/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.701967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facb67395c034cbab945c41bb2083cd8, user_id=8cc91ef925d247d58cb8dd9077efaee3, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.704659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2e25-86f3-425a-94ce-80fdda8bc0c2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.757764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1027/2063] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:58 2022] PUT /identity/v3/projects/facb67395c034cbab945c41bb2083cd8/users/8cc91ef925d247d58cb8dd9077efaee3/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:58.768879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd743a97328904c2e84d007d8babf9f3a', 'request_id': 'req-781bf508-ccb2-4e05-928b-3cd5b815469e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.769082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.769583 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.769873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.774417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd743a97328904c2e84d007d8babf9f3a', 'request_id': 'req-781bf508-ccb2-4e05-928b-3cd5b815469e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.808439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] MFA Rules not processed for user `8cc91ef925d247d58cb8dd9077efaee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.809648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.840868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd743a97328904c2e84d007d8babf9f3a', 'request_id': 'req-781bf508-ccb2-4e05-928b-3cd5b815469e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.855168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] The token cache is being invalidate because project d743a97328904c2e84d007d8babf9f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:20:58.857451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.857451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-781bf508-ccb2-4e05-928b-3cd5b815469e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:20:58.857763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1037/2064] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:20:58 2022] DELETE /identity/v3/projects/d743a97328904c2e84d007d8babf9f3a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:20:58.862762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a27bd-6e30-459b-aded-fc6a22d92522 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.863106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a27bd-6e30-459b-aded-fc6a22d92522 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.863396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a27bd-6e30-459b-aded-fc6a22d92522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.881416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-be7a27bd-6e30-459b-aded-fc6a22d92522 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.882759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-be7a27bd-6e30-459b-aded-fc6a22d92522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.883536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1028/2065] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:58.888255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:58.889621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.942194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1038/2066] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:20:58.950270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.950566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.951033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.953573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558831-c8e3-46d0-a24e-af012eaa7654 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:58.958591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:58.959836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:58.960127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:58.960406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:58.964988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:58.964988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:58.971562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:58.972774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:58.982625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1039/2067] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:58.991899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.001134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e691-05f9-40ca-888b-4f76de54da16 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.005871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.006519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.006805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.007083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.007842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:20:59.008154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.009749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.020866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1040/2068] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:20:59.030466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.040848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb4b0-57ce-4714-81fc-cb326a9722b2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.045589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.046240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.046523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.046799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.047553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.049762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.059535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1029/2069] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:58 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:59.061217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.122791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d39e-5f9f-4b84-a176-5bcd7d4c130c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.129064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.129752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.130042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.130350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.131056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.133034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.138771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1041/2070] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:59.142744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.204796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1030/2071] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:20:59.205813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.210451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0280-56a5-4207-ba16-57056318060f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.215079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.215949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.216581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6b69-4201-4f39-ab32-62b325a605c2 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.216683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.216683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.217163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.219107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.220970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.221621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.221907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.222179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.223262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.224515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.234277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1031/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:20:59.238289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.247562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142f6dd-1c12-4aed-b61f-cde3d95c858d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.252298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.253279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.253448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.253665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] PATH_INFO: `/v3/projects/a3b5e4b860534254838d5b6675b50f2d/users/c052226e2dca49f796f9271d66d6cb79/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.270141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b5e4b860534254838d5b6675b50f2d, user_id=c052226e2dca49f796f9271d66d6cb79, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.273413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.303054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1042/2073] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:59.307019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.316170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e612f7-4444-404d-a386-29ef42a7ed6f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.321267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.321884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.322162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.322435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.323182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.324767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.337622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1043/2074] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:59.338682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.344657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1032/2075] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:59 2022] PUT /identity/v3/projects/a3b5e4b860534254838d5b6675b50f2d/users/c052226e2dca49f796f9271d66d6cb79/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:59.349340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541bf0-04ed-401e-9e3a-c71c1362e316 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.353308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.421725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.422812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.423093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.423529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.424257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.426728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.430947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710490-a8cf-4a11-9310-41e332239f91 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.435746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.436429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.436712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.436988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.437901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.438023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1044/2076] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:59.439314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.441998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.449913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1033/2077] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:20:59.452703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a9efa-abb7-4202-a7b2-4384247d4fe8 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.453882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.457647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.458552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.458833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.459782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] PATH_INFO: `/v3/projects/1cc29add68934367896c85c3b76c4b64/users/dd8de17e95704ea98064a63f010b9d11/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.464016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3392-67a6-4436-8a6e-0c118d799233 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.477108 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.478085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.483160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.483355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc29add68934367896c85c3b76c4b64, user_id=dd8de17e95704ea98064a63f010b9d11, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.483437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] PATH_INFO: `/v3/projects/a3b5e4b860534254838d5b6675b50f2d/users/c052226e2dca49f796f9271d66d6cb79/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.483437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b5e4b860534254838d5b6675b50f2d, user_id=c052226e2dca49f796f9271d66d6cb79, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.485713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648a40f-5120-4a29-a9c2-40f9164818d4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.486081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7c8d-762f-463a-a3c5-9d6b704996aa admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.498065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1034/2078] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:59 2022] PUT /identity/v3/projects/a3b5e4b860534254838d5b6675b50f2d/users/c052226e2dca49f796f9271d66d6cb79/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:59.516317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.516604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.516878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.543953 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] MFA Rules not processed for user `c052226e2dca49f796f9271d66d6cb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:59.545164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:59.597443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1045/2079] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:20:59 2022] PUT /identity/v3/projects/1cc29add68934367896c85c3b76c4b64/users/dd8de17e95704ea98064a63f010b9d11/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:20:59.608826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.609121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.609403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.614793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1035/2080] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:59.631436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.636508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:59.644426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] MFA Rules not processed for user `dd8de17e95704ea98064a63f010b9d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:20:59.645657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:20:59.692717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd374db-261a-4dcc-9eab-9af881e0a26c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.707219 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1046/2081] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:20:59.711709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.748154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.748831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.749120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.749398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.776311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76889618-f1c2-493d-a3d4-b360e5583fc7 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.781258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.781913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.782202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.782485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.783167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.785097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.810090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.811918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.824428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1036/2082] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:20:59.873519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1047/2083] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:20:59.874618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.885564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221327-b8ac-421e-a0c3-3503af5374e4 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:20:59.967491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:20:59.968254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:20:59.968534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:20:59.968807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:20:59.969801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:20:59.971381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:20:59.972281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:20:59.975181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:00.038148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c74a2-5ea9-4015-8a38-854e60047631 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.043545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.044160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.044454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.044739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.092287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1037/2084] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:20:59 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:00.096213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.102455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.103952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.106020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e322-ed08-4b2d-86ee-ee7e34a455ac admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.110695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.111335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.111667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.111924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.112635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.113097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1048/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:20:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:00.114284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.124884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1038/2086] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:00.128881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.144927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd720c-1ba9-4804-9341-6111d93bcd24 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.150626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.151455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.151685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.151967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.153133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.155027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d78cfb-2fd2-4439-a345-9f1bfb007561 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.166082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1049/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:00.170909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.182389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e71a0-7c09-478c-92d9-111e293b5482 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.187588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.188480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.188768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.189127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] PATH_INFO: `/v3/projects/2f828463734b44768a39c668b1d92ed4/users/350d40e5b0a84e3fb78659914cdb2025/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.205025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f828463734b44768a39c668b1d92ed4, user_id=350d40e5b0a84e3fb78659914cdb2025, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.207955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.281156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1039/2088] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:00 2022] PUT /identity/v3/projects/2f828463734b44768a39c668b1d92ed4/users/350d40e5b0a84e3fb78659914cdb2025/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:00.293408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.293925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.294041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.320843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] MFA Rules not processed for user `350d40e5b0a84e3fb78659914cdb2025`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:00.322225 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:00.387797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1050/2089] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:00.392194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.461130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d71b2-b88c-4502-8227-4f5a177d5b86 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.466124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.466777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.467064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.467342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.468123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.470042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.585369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1040/2090] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:00 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:00.589351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.600424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644915f-51d5-4b7a-ad3e-b83870a914de None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.657686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.658366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.658651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.659452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.660175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.662833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.749456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1051/2091] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:00 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:00.758775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.771347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66310a9-d9a1-4523-ac6a-86a3d292e397 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.776977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.777888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.778334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.778619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.779347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.783654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.791673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1041/2092] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:00.796973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.809446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203ce61-dda5-43ee-a233-49649f0382a4 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:00.814273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:00.815189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:00.815485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:00.815774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] PATH_INFO: `/v3/projects/acf2704d8d9d45afa40589dd05a8bc48/users/3cccc394bd234c60b1ba79c87fce6fbc/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:00.831123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2704d8d9d45afa40589dd05a8bc48, user_id=3cccc394bd234c60b1ba79c87fce6fbc, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:00.833792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:00.944052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1052/2093] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:00 2022] PUT /identity/v3/projects/acf2704d8d9d45afa40589dd05a8bc48/users/3cccc394bd234c60b1ba79c87fce6fbc/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:00.948071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:00.958575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ae6c-4afb-41a9-b7e3-f59bc3b21c3d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:01.018548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:01.019650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:01.019938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:01.020252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:01.021149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:01.023772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e25d-95c7-408c-b7d2-cf57d3490557 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:01.041730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1042/2094] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:01.042883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:01.053981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff324-c9a2-4fd6-8630-6b67b3e89a03 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:01.058731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:01.059651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:01.059935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:01.060207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] PATH_INFO: `/v3/projects/acf2704d8d9d45afa40589dd05a8bc48/users/3cccc394bd234c60b1ba79c87fce6fbc/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:01.062196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2704d8d9d45afa40589dd05a8bc48, user_id=3cccc394bd234c60b1ba79c87fce6fbc, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:01.064940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:01.076422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1053/2095] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:01 2022] PUT /identity/v3/projects/acf2704d8d9d45afa40589dd05a8bc48/users/3cccc394bd234c60b1ba79c87fce6fbc/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:01.086991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:01.087264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:01.087576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:01.113797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] MFA Rules not processed for user `3cccc394bd234c60b1ba79c87fce6fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:01.115023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:01.183966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1043/2096] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:01.196292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:01.250059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484f9e8-3352-4895-adfa-10fa35059c3e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:01.253672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:01.254297 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:01.254581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:01.254849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:01.312025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:01.313471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:01.322851 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1054/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:03.297429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:03.308002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f556-50a2-4fa8-88f8-36062639e604 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:03.311427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:03.312095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:03.312613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:03.312893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:03.367992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:03.369420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:03.378314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1044/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:05.466315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:05.469452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:05.499069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b9b9-32a2-4368-8709-9a38ee249c73 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:05.503897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:05.504014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:05.504303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:05.504574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:05.553663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:05.555243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0b618-56ea-4f05-bd4a-7e3f3159f6bb service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:05.574699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1045/2099] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:05.580918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623550-e7aa-4c3a-bb50-8f404fdf0ae6 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:05.586548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:05.587624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:05.587947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:05.588293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] PATH_INFO: `/v3/users/8cc91ef925d247d58cb8dd9077efaee3` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:05.589640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc91ef925d247d58cb8dd9077efaee3)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:05.594571 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:05.801120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc91ef925d247d58cb8dd9077efaee3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:05.801857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc91ef925d247d58cb8dd9077efaee3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:05.820415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc91ef925d247d58cb8dd9077efaee3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:05.846719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc91ef925d247d58cb8dd9077efaee3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:05.931434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc91ef925d247d58cb8dd9077efaee3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:05.938428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1055/2100] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:05 2022] DELETE /identity/v3/users/8cc91ef925d247d58cb8dd9077efaee3 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:05.950039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:05.950039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:05.950039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:05.984786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:05.986226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:06.044339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1046/2101] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:06.054249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:06.055711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:06.156290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e4db-838e-4526-b284-3ac6c5fb4144 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:06.160230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:06.160885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:06.161185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:06.161462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:06.171511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:06.172961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:06.183601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1056/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:06.625170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:06.626618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:06.640608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0826d87-b1cd-407c-92d4-1c96b991ca5f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:06.645717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:06.647486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:06.647903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:06.648227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] PATH_INFO: `/v3/projects/facb67395c034cbab945c41bb2083cd8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:06.649424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facb67395c034cbab945c41bb2083cd8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:06.651688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:06.757619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facb67395c034cbab945c41bb2083cd8', 'request_id': 'req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:06.762751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facb67395c034cbab945c41bb2083cd8', 'request_id': 'req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:06.817605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facb67395c034cbab945c41bb2083cd8', 'request_id': 'req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:06.831193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] The token cache is being invalidate because project facb67395c034cbab945c41bb2083cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:06.831193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:06.831891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:06.833697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1047/2103] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:06 2022] DELETE /identity/v3/projects/facb67395c034cbab945c41bb2083cd8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:06.838350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:06.849942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac2-cf4c-4045-8dda-507680a9bda0 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:06.914562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:06.919633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:06.919633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:06.919633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] PATH_INFO: `/v3/users/c052226e2dca49f796f9271d66d6cb79` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:06.919633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c052226e2dca49f796f9271d66d6cb79)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:06.920140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:07.175706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c052226e2dca49f796f9271d66d6cb79'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.176514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c052226e2dca49f796f9271d66d6cb79'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.184184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c052226e2dca49f796f9271d66d6cb79'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.196262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c052226e2dca49f796f9271d66d6cb79'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.309467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60df0b23-7937-4ce3-87be-bff76e7eb977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c052226e2dca49f796f9271d66d6cb79'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.319019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1057/2104] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:06 2022] DELETE /identity/v3/users/c052226e2dca49f796f9271d66d6cb79 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:07.773599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:07.775282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:07.789306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb323-c08a-4a7f-b58c-fed3842c4f34 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:07.850239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:07.851126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:07.851404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:07.851704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] PATH_INFO: `/v3/projects/a3b5e4b860534254838d5b6675b50f2d` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:07.853327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b5e4b860534254838d5b6675b50f2d)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:07.855280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:07.948755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b5e4b860534254838d5b6675b50f2d', 'request_id': 'req-4c3fe9e7-9251-49d2-9d2f-3782319a7918'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:07.954947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b5e4b860534254838d5b6675b50f2d', 'request_id': 'req-4c3fe9e7-9251-49d2-9d2f-3782319a7918'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.045924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b5e4b860534254838d5b6675b50f2d', 'request_id': 'req-4c3fe9e7-9251-49d2-9d2f-3782319a7918'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.057918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] The token cache is being invalidate because project a3b5e4b860534254838d5b6675b50f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:08.058247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.058883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.060499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1048/2105] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:07 2022] DELETE /identity/v3/projects/a3b5e4b860534254838d5b6675b50f2d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:08.065967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b238-fbef-4d72-8291-a54701f9362d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.066450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b238-fbef-4d72-8291-a54701f9362d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.066555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b238-fbef-4d72-8291-a54701f9362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.085555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7108b238-fbef-4d72-8291-a54701f9362d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:08.086919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7108b238-fbef-4d72-8291-a54701f9362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.102229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.103752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.150543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1058/2106] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:08.158612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.158930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.159208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.168776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe9e7-9251-49d2-9d2f-3782319a7918 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.176031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.177089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.177381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.177705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] PATH_INFO: `/v3/users/147cf60b98274cc7998cc27908c7cc1e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.178969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=147cf60b98274cc7998cc27908c7cc1e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.180962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.181967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:08.183416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.194397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1059/2107] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:08.198549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.207767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca067f4-5d9c-4b14-82e7-e2f427a99844 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.213407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.214051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.214336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.214611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.215329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:08.215673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.217353 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.228980 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1060/2108] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:21:08.233251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.242480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b730d-77f1-41c4-ae00-bb74e73a1c33 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.247079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.247719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.249325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.249325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.249325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.250738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.327607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1061/2109] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:08.332221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.398421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2582832-d910-4048-b014-8431dbd77ea3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.400072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147cf60b98274cc7998cc27908c7cc1e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.404490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.405189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.405473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.405752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.406463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.408443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.409783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147cf60b98274cc7998cc27908c7cc1e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.423048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147cf60b98274cc7998cc27908c7cc1e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.521047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1062/2110] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:08.527775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147cf60b98274cc7998cc27908c7cc1e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.527947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.528965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5b638abd-6916-4cc6-9c48-690956fe17dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147cf60b98274cc7998cc27908c7cc1e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:08.539568 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1049/2111] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:08 2022] DELETE /identity/v3/users/147cf60b98274cc7998cc27908c7cc1e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:08.541246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.541589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.541964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.549347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.584643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598d1b4-bc67-40c3-aa1d-1a5d8cbcaa33 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.608905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:08.611708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.643990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.647606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.647606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.647606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.647606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.647606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.657924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1063/2112] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:08.661585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.670799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1905e9-6086-4b9a-a2fd-31e3349bc0c5 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.674032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1050/2113] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:08.677276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.678471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.678772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.679111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.679831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.681476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.687136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.688647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.697861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1064/2114] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:08.698905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.708381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898ad8-715e-4ede-aefb-227ace6991a6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.713220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.714078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.714360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.714636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] PATH_INFO: `/v3/projects/d7a3533b3f804c4199c15a1e386e9762/users/d7615cd7bdea41348d7902e14ebd164f/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.729862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a3533b3f804c4199c15a1e386e9762, user_id=d7615cd7bdea41348d7902e14ebd164f, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.733835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.755111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7068b9-d312-401c-850f-d76887246e8d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:08.759973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:08.760637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.760933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.761402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.774392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:08.774392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f459af2-322b-4372-847c-37ab9358659d service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:08.783586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1051/2115] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:08.796208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1065/2116] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:08 2022] PUT /identity/v3/projects/d7a3533b3f804c4199c15a1e386e9762/users/d7615cd7bdea41348d7902e14ebd164f/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:08.819073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:08.819073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:08.819073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:08.844713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] MFA Rules not processed for user `d7615cd7bdea41348d7902e14ebd164f`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:08.846659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:08.914159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1052/2117] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:08.919936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:08.986110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3961f-6e36-4a81-afdb-25022cb7d875 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.000668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.001939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.002480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.003074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.003810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.006060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.118570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1066/2118] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:09.122760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.134361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910dd0c-0221-4731-8dc6-a450bbf18bf3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.195620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.196298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.196584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.196863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.197553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.199502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.242705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.244910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:09.257755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a579406-b354-432c-a813-9afa6b9fdd3c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.262512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.263372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.263694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.263977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] PATH_INFO: `/v3/projects/2ec05a9af62c48f880ada5c3caf863f1` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.265174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec05a9af62c48f880ada5c3caf863f1)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.267324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.295290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1053/2119] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:09 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:09.296299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.306562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588838ac-de92-46d2-95bf-32e6cc24d3da admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.311755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.312438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.312726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.313006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.313774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.315386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.325731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1054/2120] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:09.329795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.339668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37001c28-1b26-41d9-940f-9fff9fca7f72 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.344416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.345114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.350267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.350267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.350267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.350267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.362950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1055/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:09.364109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.374281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14eb3-5873-454a-8f7b-d419ba0c5a58 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.378961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.379913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.380197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.380470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] PATH_INFO: `/v3/projects/aca1c84b0f0646d0b6d9bfcf4f0ae8e8/users/5e49f2cc83df406694922ab211cf33c8/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.394895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca1c84b0f0646d0b6d9bfcf4f0ae8e8, user_id=5e49f2cc83df406694922ab211cf33c8, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.398132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcee77-b7ad-4baf-b257-a768544ee2c0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.400388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec05a9af62c48f880ada5c3caf863f1', 'request_id': 'req-75cf7aad-30b8-4fc3-b312-713e44a8f038'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.406326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec05a9af62c48f880ada5c3caf863f1', 'request_id': 'req-75cf7aad-30b8-4fc3-b312-713e44a8f038'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.474229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1056/2122] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:09 2022] PUT /identity/v3/projects/aca1c84b0f0646d0b6d9bfcf4f0ae8e8/users/5e49f2cc83df406694922ab211cf33c8/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:09.485095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d668-f786-4714-b995-2380b06943f9 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.485382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d668-f786-4714-b995-2380b06943f9 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.485661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d668-f786-4714-b995-2380b06943f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.510857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f291d668-f786-4714-b995-2380b06943f9 None None] MFA Rules not processed for user `5e49f2cc83df406694922ab211cf33c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:09.512072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f291d668-f786-4714-b995-2380b06943f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:09.514170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec05a9af62c48f880ada5c3caf863f1', 'request_id': 'req-75cf7aad-30b8-4fc3-b312-713e44a8f038'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.528093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] The token cache is being invalidate because project 2ec05a9af62c48f880ada5c3caf863f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:09.528858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.529249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.530821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1067/2123] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:09 2022] DELETE /identity/v3/projects/2ec05a9af62c48f880ada5c3caf863f1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:09.534636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.536212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:09.578484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1057/2124] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:09.585123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d668-f786-4714-b995-2380b06943f9 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.587967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f291d668-f786-4714-b995-2380b06943f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:09.603231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7aad-30b8-4fc3-b312-713e44a8f038 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.663761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d668-f786-4714-b995-2380b06943f9 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.665738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.666611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.666892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.667194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] PATH_INFO: `/v3/users/5bf0a5dee7cd44d3bcb40ea0da02ba55` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.668594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf0a5dee7cd44d3bcb40ea0da02ba55)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.668726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.669382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.669676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.669955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.670555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.670665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.672580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.767834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1058/2125] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:09 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:09.772334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.838171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf0a5dee7cd44d3bcb40ea0da02ba55'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.839354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf0a5dee7cd44d3bcb40ea0da02ba55'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.845804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f5a82-ea85-4e84-b7f5-8bd050598796 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:09.847875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf0a5dee7cd44d3bcb40ea0da02ba55'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.850815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:09.851512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:09.851780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:09.852056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:09.852739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:09.855522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:09.859213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf0a5dee7cd44d3bcb40ea0da02ba55'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.914637 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf0a5dee7cd44d3bcb40ea0da02ba55'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:09.921041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1068/2126] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:09 2022] DELETE /identity/v3/users/5bf0a5dee7cd44d3bcb40ea0da02ba55 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:09.947923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1059/2127] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:09 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:09.949623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:09.951099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.016167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e42e-a986-4bbf-b642-7f218afe5bc6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.020884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.022096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.022383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.022657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.023379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.025009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.034959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1069/2128] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:10.039315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.049420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25e4ee-4f9d-4881-9cf4-969cf1fce0ac admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.055135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.056061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.056344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.056624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] PATH_INFO: `/v3/projects/e1d901768c514d798358f8e013cb2278/users/03cd630d022b4af6b8dca4563f5d6be1/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.072476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d901768c514d798358f8e013cb2278, user_id=03cd630d022b4af6b8dca4563f5d6be1, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.075161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.142411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1060/2129] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:10 2022] PUT /identity/v3/projects/e1d901768c514d798358f8e013cb2278/users/03cd630d022b4af6b8dca4563f5d6be1/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:10.143015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.156030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc229e8-6fcd-467f-98ce-5ac07a47f4a2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.221610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.222288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.222573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.222850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.223658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.225392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a60179-f9ee-46b0-849b-11b4648cab98 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.239514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1070/2130] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:10.241761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.251869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57400f-b20c-41b9-a808-f9042899c267 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.257170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.258061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.258344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.258639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] PATH_INFO: `/v3/projects/e1d901768c514d798358f8e013cb2278/users/03cd630d022b4af6b8dca4563f5d6be1/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.260611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d901768c514d798358f8e013cb2278, user_id=03cd630d022b4af6b8dca4563f5d6be1, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.263696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.273832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1061/2131] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:10 2022] PUT /identity/v3/projects/e1d901768c514d798358f8e013cb2278/users/03cd630d022b4af6b8dca4563f5d6be1/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:10.284293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.288279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.288279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.312295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] MFA Rules not processed for user `03cd630d022b4af6b8dca4563f5d6be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:10.313514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.333815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.335687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.389246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1071/2132] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:10.400514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.402112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.406392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da3ba1-8f76-4144-a740-6acdb19c056c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.411104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.412053 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.412340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.412616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] PATH_INFO: `/v3/projects/7281d1fe150443db9c601cc4303f4c83` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.413853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7281d1fe150443db9c601cc4303f4c83)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.415810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.469756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c41c6-ad46-4842-b2e3-b99033e6bb6a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.473845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.475214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.475528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.475807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.485712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.487157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.498533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1072/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:10.499369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.500673 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.513748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f7b0-d763-40bd-ab55-84d2c9f55a44 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.518421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.519289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.519698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.519974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] PATH_INFO: `/v3/users/dd8de17e95704ea98064a63f010b9d11` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.521209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8de17e95704ea98064a63f010b9d11)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.523228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.548444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7281d1fe150443db9c601cc4303f4c83', 'request_id': 'req-bf8e9707-c0f1-4699-a6db-96ee7e39b351'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.554840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7281d1fe150443db9c601cc4303f4c83', 'request_id': 'req-bf8e9707-c0f1-4699-a6db-96ee7e39b351'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.624876 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7281d1fe150443db9c601cc4303f4c83', 'request_id': 'req-bf8e9707-c0f1-4699-a6db-96ee7e39b351'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.636245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] The token cache is being invalidate because project 7281d1fe150443db9c601cc4303f4c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:10.636533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.637176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-bf8e9707-c0f1-4699-a6db-96ee7e39b351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.638924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1062/2134] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:10 2022] DELETE /identity/v3/projects/7281d1fe150443db9c601cc4303f4c83 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:10.643536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d0f14-dcb9-43ce-9cee-478a78a4e7af None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.643826 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d0f14-dcb9-43ce-9cee-478a78a4e7af None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.644105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d0f14-dcb9-43ce-9cee-478a78a4e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.680699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-eb1d0f14-dcb9-43ce-9cee-478a78a4e7af None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:10.681952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-eb1d0f14-dcb9-43ce-9cee-478a78a4e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.703901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8de17e95704ea98064a63f010b9d11'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.704778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8de17e95704ea98064a63f010b9d11'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.712055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8de17e95704ea98064a63f010b9d11'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.723891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8de17e95704ea98064a63f010b9d11'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.748128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1063/2135] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:10.756027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.756335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.756633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.774641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:10.775777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.788376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1064/2136] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:10.790797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.800557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32e4e-0512-4d4d-88a4-0ac3148b05a3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.806218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ae21ea30-2791-466b-bc77-c2f7e72c8965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8de17e95704ea98064a63f010b9d11'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:10.811005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.812420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.812794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.813180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.814359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:10.814716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.817641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.822166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1073/2137] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:10 2022] DELETE /identity/v3/users/dd8de17e95704ea98064a63f010b9d11 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:10.823753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.824046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.824324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.836759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1065/2138] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:21:10.843874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.846966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:10.848463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.858407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a58bd-38c4-4aa9-a050-b85649a18688 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.925525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1074/2139] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:10.934996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:10.936379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:10.941952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.942705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.943316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.943698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:10.944466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:10.946479 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:10.992275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60d2a-3ec1-47dd-9c83-75802fdad992 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:10.995891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:10.996531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:10.996809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:10.997083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.005783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.007203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.016232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1075/2140] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:11.065757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1066/2141] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:10 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:11.069922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.082055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ba58-38df-44bb-8ad6-2913e233fe4e service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.140939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.141610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.141945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.142202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.142893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.144806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.219558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1076/2142] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:11 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:11.223750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.234301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d40e2-ee6f-45b6-ab4c-3f63d4b588d7 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.241035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.241782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.242613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.242613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.243171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.244766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.255289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1067/2143] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:11.259745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.269909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e7fb8-3cb3-4936-9622-9595cf5f2735 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.275117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.275823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.276105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.276381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.277599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.278951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65818c-c7e0-490b-91bf-5598f7ad21f8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.293385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1077/2144] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:11.297529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.307348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5e13e-2c97-4cea-8e85-da9e1168cfb8 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.311974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.312841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.313118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.313390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] PATH_INFO: `/v3/projects/72d347d13ef942a6b7a3db95581ea92e/users/56c56727c5fe4152ac3dedcfb4739dec/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.328935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d347d13ef942a6b7a3db95581ea92e, user_id=56c56727c5fe4152ac3dedcfb4739dec, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.331699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.422779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1068/2145] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:11 2022] PUT /identity/v3/projects/72d347d13ef942a6b7a3db95581ea92e/users/56c56727c5fe4152ac3dedcfb4739dec/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:11.433858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.434143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.434420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.454034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.457398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.486730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] MFA Rules not processed for user `56c56727c5fe4152ac3dedcfb4739dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:11.488350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.553956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827e0a-f017-4bf3-a6f4-c0b79bc74dca admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.559670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.561096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.561446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.561810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] PATH_INFO: `/v3/projects/1cc29add68934367896c85c3b76c4b64` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.564557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc29add68934367896c85c3b76c4b64)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.567052 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.573942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1078/2146] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:11.580058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.590519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c448bd1-3b8c-4a01-b14c-ae30c9a8d79e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.595262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.596060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.596423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.596704 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.597399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.599351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.720625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc29add68934367896c85c3b76c4b64', 'request_id': 'req-62b6b3fb-254b-4e18-b8f9-67788706d20e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:11.726330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc29add68934367896c85c3b76c4b64', 'request_id': 'req-62b6b3fb-254b-4e18-b8f9-67788706d20e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:11.740380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1079/2147] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:11 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:11.741221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.742770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.783399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc29add68934367896c85c3b76c4b64', 'request_id': 'req-62b6b3fb-254b-4e18-b8f9-67788706d20e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:11.795107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] The token cache is being invalidate because project 1cc29add68934367896c85c3b76c4b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:11.795548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:11.796478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:11.797769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a3f4-fe48-45ba-aeba-f84b4af59f92 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.798016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1069/2148] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:11 2022] DELETE /identity/v3/projects/1cc29add68934367896c85c3b76c4b64 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:11.801681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.801829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.802325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.803196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.803503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.803603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.805234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.864180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.866194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.868131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6b3fb-254b-4e18-b8f9-67788706d20e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.874911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1080/2149] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:11.875731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:11.877101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:11.928408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.928850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.929139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.929417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.930098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.932118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:11.946341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab395f41-f2a3-4e88-b97b-16514069af61 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:11.952121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:11.957108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:11.957108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:11.957108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] PATH_INFO: `/v3/users/350d40e5b0a84e3fb78659914cdb2025` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:11.957108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=350d40e5b0a84e3fb78659914cdb2025)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:11.957656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.012141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1070/2150] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:11 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:12.018476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.029174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d4a4-ccae-4e7d-8e9c-2470d38ab91f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.034025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.034681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.034966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.035242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.036000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.039322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.049824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1071/2151] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:12.054551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.067374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa20-2933-4a71-9203-081a2bca4bc5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.072475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.073250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.073587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.073875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.074864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.076527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.087361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1072/2152] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:12.091451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.107383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83f7e4-b81b-494b-86a0-381c560fa04b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.112192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.113076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.113358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.113669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] PATH_INFO: `/v3/projects/b516b516471741559178f66cb8f3dc63/users/c9d3dc10ee5e4c36a53b162c18a86d9a/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.132059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b516b516471741559178f66cb8f3dc63, user_id=c9d3dc10ee5e4c36a53b162c18a86d9a, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.134739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5cc97-3736-46c0-9bde-a69c3e4713f2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.145979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350d40e5b0a84e3fb78659914cdb2025'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.146697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350d40e5b0a84e3fb78659914cdb2025'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.154023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350d40e5b0a84e3fb78659914cdb2025'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.169820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350d40e5b0a84e3fb78659914cdb2025'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.200774 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1073/2153] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:12 2022] PUT /identity/v3/projects/b516b516471741559178f66cb8f3dc63/users/c9d3dc10ee5e4c36a53b162c18a86d9a/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:12.212678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.212972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.213251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.239422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] MFA Rules not processed for user `c9d3dc10ee5e4c36a53b162c18a86d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:12.241360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:12.280170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350d40e5b0a84e3fb78659914cdb2025'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.287302 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1081/2154] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:11 2022] DELETE /identity/v3/users/350d40e5b0a84e3fb78659914cdb2025 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:12.306980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1074/2155] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:12.311411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.312933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:12.380439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346feca-fcd9-4c64-9837-f946e9af9bcd admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.385454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.386208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.386528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.386770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.387556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.389533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.533212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1082/2156] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:12 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:12.536385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.635393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4c45-d98e-454c-9409-837788ba6051 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.705495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.711656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.711783 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:12.711887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.711887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.711887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.711887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.712139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.728257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37db89-35f9-4bf1-88ea-dc5a95e30444 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.738490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.744166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.744166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.744166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] PATH_INFO: `/v3/projects/2f828463734b44768a39c668b1d92ed4` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.744166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f828463734b44768a39c668b1d92ed4)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.744166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.817521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1075/2157] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:12 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:12.821635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.832296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f383f-fad0-413b-8dcb-8b38bf7fab19 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.837574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.838229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.838518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.838829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.839590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.841196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.850893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1076/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:12.857664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:12.866839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bcbf-4e09-4524-9083-94cbd2369499 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:12.871748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:12.872644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:12.872947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:12.873353 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] PATH_INFO: `/v3/projects/4b64c131f51841649b76fe9281c1f0f9/users/7147c54975a242748163f909355dcb2d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:12.888765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b64c131f51841649b76fe9281c1f0f9, user_id=7147c54975a242748163f909355dcb2d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:12.891490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:12.892486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f828463734b44768a39c668b1d92ed4', 'request_id': 'req-08494840-0544-4645-b74c-de238a7778fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.898489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f828463734b44768a39c668b1d92ed4', 'request_id': 'req-08494840-0544-4645-b74c-de238a7778fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:12.994560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1077/2159] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:12 2022] PUT /identity/v3/projects/4b64c131f51841649b76fe9281c1f0f9/users/7147c54975a242748163f909355dcb2d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:12.998404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.011732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f828463734b44768a39c668b1d92ed4', 'request_id': 'req-08494840-0544-4645-b74c-de238a7778fe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.025471 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] The token cache is being invalidate because project 2f828463734b44768a39c668b1d92ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:13.025767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.026464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.028556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1083/2160] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:12 2022] DELETE /identity/v3/projects/2f828463734b44768a39c668b1d92ed4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:13.032417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.033879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.063207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e795-63dc-442c-831f-48ededdaf608 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.068797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.069464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.069751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.070029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.070757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.072403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:13.086366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1078/2161] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:13.092964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.092964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.096588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494840-0544-4645-b74c-de238a7778fe admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.101255 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beba34-64ea-4e52-9589-9771e2ab3657 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.101380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.102142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.102419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.102688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] PATH_INFO: `/v3/users/3cccc394bd234c60b1ba79c87fce6fbc` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.103917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cccc394bd234c60b1ba79c87fce6fbc)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.105818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:13.106031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.106937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.107221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.107524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] PATH_INFO: `/v3/projects/4b64c131f51841649b76fe9281c1f0f9/users/7147c54975a242748163f909355dcb2d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.109576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b64c131f51841649b76fe9281c1f0f9, user_id=7147c54975a242748163f909355dcb2d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.112346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1919d-96d8-4c7e-9e4e-e858a17cde85 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:13.122882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1079/2162] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:13 2022] PUT /identity/v3/projects/4b64c131f51841649b76fe9281c1f0f9/users/7147c54975a242748163f909355dcb2d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:13.136954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.137715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.137715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.165435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] MFA Rules not processed for user `7147c54975a242748163f909355dcb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:13.166659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.251553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1080/2163] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:13.260457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.261855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.307778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cccc394bd234c60b1ba79c87fce6fbc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.308490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cccc394bd234c60b1ba79c87fce6fbc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.315299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cccc394bd234c60b1ba79c87fce6fbc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.322186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c58f-506d-452f-96a0-3ab9adc3ea00 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.326195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.326832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.327122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.327395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.327827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cccc394bd234c60b1ba79c87fce6fbc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.329235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.341578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.343006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:13.352448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1081/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:13.400150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cccc394bd234c60b1ba79c87fce6fbc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:13.406832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1084/2165] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:13 2022] DELETE /identity/v3/users/3cccc394bd234c60b1ba79c87fce6fbc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:13.451620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.453175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.464274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368800a4-8b36-48d2-b019-4067ae749c09 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.512224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.512874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.513157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.513434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.515256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.574645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.576196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13279dc-ce86-492d-a7b4-10dd636e9c81 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:13.585017 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1082/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:13.804589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:13.806453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:13.881496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1414d62-044a-48b6-99df-4647c587075c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:13.886480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:13.887342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:13.887702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:13.887974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] PATH_INFO: `/v3/projects/acf2704d8d9d45afa40589dd05a8bc48` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:13.889164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf2704d8d9d45afa40589dd05a8bc48)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:13.891135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:14.023831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf2704d8d9d45afa40589dd05a8bc48', 'request_id': 'req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:14.029871 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf2704d8d9d45afa40589dd05a8bc48', 'request_id': 'req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:14.097494 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf2704d8d9d45afa40589dd05a8bc48', 'request_id': 'req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:14.108930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] The token cache is being invalidate because project acf2704d8d9d45afa40589dd05a8bc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:14.109233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:14.109866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:14.111432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1085/2167] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:13 2022] DELETE /identity/v3/projects/acf2704d8d9d45afa40589dd05a8bc48 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:16.456392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:16.456887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:16.456987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:16.475986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] MFA Rules not processed for user `14313ce3f35f4468add7fbc073f90f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:16.477137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:16.529198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1083/2168] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:17.009020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:17.010520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:17.067887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d4d9-ced6-4d1d-b429-5d2d4c1d174b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:17.072588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:17.073340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:17.073568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:17.073848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:17.075639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:17.135005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:17.136552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722b3a-39b3-4048-86d8-0b8d0133b19c service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:17.145718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1086/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:17.759300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:17.761761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:17.823300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2502cf-a5a5-46c0-b6b9-566736cc601b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:17.830854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:17.831382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:17.831803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:17.832080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] PATH_INFO: `/v3/users/56c56727c5fe4152ac3dedcfb4739dec` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:17.833405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c56727c5fe4152ac3dedcfb4739dec)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:17.835972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:18.054490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c56727c5fe4152ac3dedcfb4739dec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.062190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c56727c5fe4152ac3dedcfb4739dec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.074703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c56727c5fe4152ac3dedcfb4739dec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.154830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c56727c5fe4152ac3dedcfb4739dec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.155447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c56727c5fe4152ac3dedcfb4739dec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.161739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1084/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:17 2022] DELETE /identity/v3/users/56c56727c5fe4152ac3dedcfb4739dec => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:18.167021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:18.167508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:18.167634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:18.186903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:18.188415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:18.249697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1087/2171] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:18.259541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:18.261077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:18.317253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d34f6-bd6b-470d-8edb-ecc99f76f9ed admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:18.321528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:18.322168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:18.322450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:18.322742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:18.331374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:18.332852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:18.342083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1085/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:18.738679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:18.740190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:18.752829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670946-6d09-4566-a2f0-4ba47d8f1a3c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:18.758126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:18.759114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:18.759259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:18.759555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] PATH_INFO: `/v3/projects/72d347d13ef942a6b7a3db95581ea92e` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:18.760920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d347d13ef942a6b7a3db95581ea92e)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:18.762862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:18.881717 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d347d13ef942a6b7a3db95581ea92e', 'request_id': 'req-fac1651f-2918-400a-9d16-1c79aa844971'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.887262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d347d13ef942a6b7a3db95581ea92e', 'request_id': 'req-fac1651f-2918-400a-9d16-1c79aa844971'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.960984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d347d13ef942a6b7a3db95581ea92e', 'request_id': 'req-fac1651f-2918-400a-9d16-1c79aa844971'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.972619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] The token cache is being invalidate because project 72d347d13ef942a6b7a3db95581ea92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:18.972910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.973625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:18.975238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1088/2173] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:18 2022] DELETE /identity/v3/projects/72d347d13ef942a6b7a3db95581ea92e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:18.979898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:18.989553 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189c50-a652-47b8-a613-29feff01734d service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:19.052964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:19.054719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:19.055061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:19.055345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] PATH_INFO: `/v3/users/c9d3dc10ee5e4c36a53b162c18a86d9a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:19.056903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d3dc10ee5e4c36a53b162c18a86d9a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:19.059425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:19.258923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d3dc10ee5e4c36a53b162c18a86d9a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:19.265503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d3dc10ee5e4c36a53b162c18a86d9a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:19.277867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d3dc10ee5e4c36a53b162c18a86d9a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:19.359846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d3dc10ee5e4c36a53b162c18a86d9a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:19.360477 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d3dc10ee5e4c36a53b162c18a86d9a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:19.366687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1086/2174] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:18 2022] DELETE /identity/v3/users/c9d3dc10ee5e4c36a53b162c18a86d9a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:19.912019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:19.914578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:19.928373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1651f-2918-400a-9d16-1c79aa844971 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:20.003539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:20.003539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:20.003539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:20.003539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] PATH_INFO: `/v3/projects/b516b516471741559178f66cb8f3dc63` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:20.003890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b516b516471741559178f66cb8f3dc63)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:20.008275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:20.156319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b516b516471741559178f66cb8f3dc63', 'request_id': 'req-92e55200-a67e-42be-b41f-7c49da865b24'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.161672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b516b516471741559178f66cb8f3dc63', 'request_id': 'req-92e55200-a67e-42be-b41f-7c49da865b24'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.263442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b516b516471741559178f66cb8f3dc63', 'request_id': 'req-92e55200-a67e-42be-b41f-7c49da865b24'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.275150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] The token cache is being invalidate because project b516b516471741559178f66cb8f3dc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:20.275581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.276239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.278258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1089/2175] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:19 2022] DELETE /identity/v3/projects/b516b516471741559178f66cb8f3dc63 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:20.282085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:20.283640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:20.297234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3f62-f111-409a-ac58-28c1cc625f5f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:20.353977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:20.354786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:20.355071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:20.355359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] PATH_INFO: `/v3/users/7147c54975a242748163f909355dcb2d` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:20.356665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7147c54975a242748163f909355dcb2d)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:20.358624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:20.506415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7147c54975a242748163f909355dcb2d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.514076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7147c54975a242748163f909355dcb2d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.528880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7147c54975a242748163f909355dcb2d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.617519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7147c54975a242748163f909355dcb2d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.618098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7147c54975a242748163f909355dcb2d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:20.624430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1087/2176] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:20 2022] DELETE /identity/v3/users/7147c54975a242748163f909355dcb2d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:21.091510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:21.095217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.110853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55200-a67e-42be-b41f-7c49da865b24 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:21.188726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:21.190409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.190856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.191191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] PATH_INFO: `/v3/users/d7615cd7bdea41348d7902e14ebd164f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.192526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7615cd7bdea41348d7902e14ebd164f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:21.194638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:21.383042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7615cd7bdea41348d7902e14ebd164f'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.383751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7615cd7bdea41348d7902e14ebd164f'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.391394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7615cd7bdea41348d7902e14ebd164f'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.411581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7615cd7bdea41348d7902e14ebd164f'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.493862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:21.495927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.510077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d0b20735-9f7e-4c47-9d02-6bae037154fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7615cd7bdea41348d7902e14ebd164f'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.512780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928155-c0c7-41b5-85ea-ad175e927ccf admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:21.518372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:21.520880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.520880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.520880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] PATH_INFO: `/v3/projects/4b64c131f51841649b76fe9281c1f0f9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.521176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b64c131f51841649b76fe9281c1f0f9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:21.523314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:21.524922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1090/2177] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:21 2022] DELETE /identity/v3/users/d7615cd7bdea41348d7902e14ebd164f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:21.529564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.529852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.530130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.560407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:21.561720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.624867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1091/2178] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:21.634451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:21.635859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.644138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b64c131f51841649b76fe9281c1f0f9', 'request_id': 'req-ee0d3e35-098d-44a1-bc3b-3af1dade7808'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.655631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b64c131f51841649b76fe9281c1f0f9', 'request_id': 'req-ee0d3e35-098d-44a1-bc3b-3af1dade7808'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.715042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b64c131f51841649b76fe9281c1f0f9', 'request_id': 'req-ee0d3e35-098d-44a1-bc3b-3af1dade7808'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.732838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] The token cache is being invalidate because project 4b64c131f51841649b76fe9281c1f0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:21.733131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.733802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ee0d3e35-098d-44a1-bc3b-3af1dade7808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:21.735104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e37ddb-a127-43f4-b094-ae137dd40f54 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:21.736327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1088/2179] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:21 2022] DELETE /identity/v3/projects/4b64c131f51841649b76fe9281c1f0f9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:21.745497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c20e-fdee-4793-a4bc-854966f7f8db None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.746273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c20e-fdee-4793-a4bc-854966f7f8db None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.746951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c20e-fdee-4793-a4bc-854966f7f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.771441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7169c20e-fdee-4793-a4bc-854966f7f8db None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:21.774184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7169c20e-fdee-4793-a4bc-854966f7f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.805769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:21.806428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.806715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.806993 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.809443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.866868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1089/2180] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:21.876351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.876654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.876940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.898672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:21.899611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:21.899938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:21.901211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:21.908855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1090/2181] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:21.913718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1092/2182] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:21.913843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:21.926623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48b69c-41ac-4c1f-826e-38979e938f66 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:21.932320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:21.933154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.933439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.933712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.934442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:21.934748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:21.936469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:21.948893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1091/2183] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:21:21.953005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:21.963228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a99cb-639d-40e8-a645-eef2500b7129 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:21.970731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:21.972499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:21.972782 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:21.973060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:21.973776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:21.976541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.079537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1093/2184] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:21 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:22.082700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.104095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b17f-05c8-465f-b6b3-a8d20299895d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.212184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.212991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.213343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.213686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.214602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.217020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.310927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1092/2185] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:22 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:22.315439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.327602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176624d9-64fc-4894-8d67-a245c3f1fd2d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.332576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187660-318a-4520-a503-97f2c736177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.333363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187660-318a-4520-a503-97f2c736177b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.333744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187660-318a-4520-a503-97f2c736177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.334744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187660-318a-4520-a503-97f2c736177b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.335616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11187660-318a-4520-a503-97f2c736177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.337380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11187660-318a-4520-a503-97f2c736177b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.351408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1094/2186] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:22.355619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.368565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270aaea-15e7-44fa-a611-ab57e54318a4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.374151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.374939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.375386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.375932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.376771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.378486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.390468 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1093/2187] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:22.394745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187660-318a-4520-a503-97f2c736177b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.405905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187660-318a-4520-a503-97f2c736177b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.411453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.412581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.413409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.413865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] PATH_INFO: `/v3/projects/e0edf81a743b4ac7b223e4d9bb398788/users/da8f46cb0f6b45379cc546a643b88b6c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.431862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0edf81a743b4ac7b223e4d9bb398788, user_id=da8f46cb0f6b45379cc546a643b88b6c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.436083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1c92-ed8d-4b02-b6b8-1f0aec2913c9 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.462127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.467188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:22.483250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787827-843a-4f25-ab1f-d19601a1d23c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.490851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.492525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.492989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.493415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] PATH_INFO: `/v3/projects/d7a3533b3f804c4199c15a1e386e9762` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.494908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a3533b3f804c4199c15a1e386e9762)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.498976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.545362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1095/2188] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:22 2022] PUT /identity/v3/projects/e0edf81a743b4ac7b223e4d9bb398788/users/da8f46cb0f6b45379cc546a643b88b6c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:22.556323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.556690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.557041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.584189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] MFA Rules not processed for user `da8f46cb0f6b45379cc546a643b88b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:22.586020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:22.613471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a3533b3f804c4199c15a1e386e9762', 'request_id': 'req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:22.619249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a3533b3f804c4199c15a1e386e9762', 'request_id': 'req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:22.653423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1096/2189] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:22.657790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.715410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a3533b3f804c4199c15a1e386e9762', 'request_id': 'req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:22.724614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8851-afc6-4d9d-9e68-4a7bae08a3af None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.734621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] The token cache is being invalidate because project d7a3533b3f804c4199c15a1e386e9762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:22.734621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:22.740719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:22.740719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1094/2190] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:22 2022] DELETE /identity/v3/projects/d7a3533b3f804c4199c15a1e386e9762 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:22.740719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.740719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:22.783306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.784016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.784319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.784583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.785268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.787193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.806202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa0a4-2cfe-4296-a1a7-bd807e6466d2 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.811001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.815117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.815117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.815117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] PATH_INFO: `/v3/users/fa4c4b0fed5b4bb99f89b4728d5e29cc` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.815117 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4c4b0fed5b4bb99f89b4728d5e29cc)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.815949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:22.876880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1097/2191] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:22 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:22.878227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:22.879938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:22.943646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e8f5-c51d-4df0-8f51-27a598629179 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:22.948344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:22.949211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:22.949492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:22.949767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] PATH_INFO: `/v3/users/5e49f2cc83df406694922ab211cf33c8` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:22.950978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e49f2cc83df406694922ab211cf33c8)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:22.952927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.007901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4c4b0fed5b4bb99f89b4728d5e29cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.014867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4c4b0fed5b4bb99f89b4728d5e29cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.027280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4c4b0fed5b4bb99f89b4728d5e29cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.114824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4c4b0fed5b4bb99f89b4728d5e29cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.115452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4c4b0fed5b4bb99f89b4728d5e29cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.121618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1095/2192] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:22 2022] DELETE /identity/v3/users/fa4c4b0fed5b4bb99f89b4728d5e29cc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:23.122475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.123816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.145074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e49f2cc83df406694922ab211cf33c8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.145771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e49f2cc83df406694922ab211cf33c8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.153862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e49f2cc83df406694922ab211cf33c8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.166015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e49f2cc83df406694922ab211cf33c8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.187349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cb82-2436-4ac7-88c0-72b6427f9976 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.192344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.193016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.193304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.193581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.194917 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.196819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.246516 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-23682247-a397-42a8-9dc6-83f51b07906b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e49f2cc83df406694922ab211cf33c8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:23.252812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1098/2193] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:22 2022] DELETE /identity/v3/users/5e49f2cc83df406694922ab211cf33c8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:23.254157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.254538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.257580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.273733 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:23.275636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.279736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1096/2194] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:23 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:23.281135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.283061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.295506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af0bd-227a-49f8-b2ac-22df78258e8a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.345085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1099/2195] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:23.352398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.353147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.353429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.353702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.354429 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.356324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.357344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.359003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.367202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1097/2196] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:23.371231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.382096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75c6e-afc0-4b72-aa8c-61c87f11aafc admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.387192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.388227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.388543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.388819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] PATH_INFO: `/v3/projects/166e00207f3d4f20a25426475ffb79e4/users/e8b926bb51ba495dbf2e9107b07fa19a/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.404899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e00207f3d4f20a25426475ffb79e4, user_id=e8b926bb51ba495dbf2e9107b07fa19a, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.407697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.418031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d0bf5-b5bf-4da2-85e9-5e02c038abcc None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.422021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.422716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.423028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.423299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.432468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.433889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.443231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1100/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:23.480507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1098/2198] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:23 2022] PUT /identity/v3/projects/166e00207f3d4f20a25426475ffb79e4/users/e8b926bb51ba495dbf2e9107b07fa19a/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:23.484681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.494397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bff84-2c93-416d-b67e-e5c1f152fb63 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.580999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.582103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.582103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.582277 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.583171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.585574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b7e9-dc42-43a6-bb5b-b4b7d715595c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.597015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1101/2199] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:23.605063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.615609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf009-b29b-4d48-a395-d955ed090692 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.621372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.622342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.622694 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.623041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] PATH_INFO: `/v3/projects/166e00207f3d4f20a25426475ffb79e4/users/e8b926bb51ba495dbf2e9107b07fa19a/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.625158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e00207f3d4f20a25426475ffb79e4, user_id=e8b926bb51ba495dbf2e9107b07fa19a, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.628074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.639041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1099/2200] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:23 2022] PUT /identity/v3/projects/166e00207f3d4f20a25426475ffb79e4/users/e8b926bb51ba495dbf2e9107b07fa19a/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:23.657701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.657992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.658272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.684677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] MFA Rules not processed for user `e8b926bb51ba495dbf2e9107b07fa19a`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:23.685889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.723451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.725472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.757775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1102/2201] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:23.776635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.779466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.817063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29294-328e-4660-9b85-24d464ca61f3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.822405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.823208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.823508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.823785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] PATH_INFO: `/v3/projects/aca1c84b0f0646d0b6d9bfcf4f0ae8e8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.824970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca1c84b0f0646d0b6d9bfcf4f0ae8e8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.826905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.845520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ceb1-7b93-403e-b64a-40cbd2833b73 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:23.849293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:23.849934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:23.850233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:23.854428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:23.860371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:23.861831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:23.871092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1103/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:23.940732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:23.942293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:23.961788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdf564-381b-41ad-a20d-07e3b8bf1cfa service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.025140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca1c84b0f0646d0b6d9bfcf4f0ae8e8', 'request_id': 'req-6a4ec71b-5d92-44df-99fd-e529621b5515'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.034270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca1c84b0f0646d0b6d9bfcf4f0ae8e8', 'request_id': 'req-6a4ec71b-5d92-44df-99fd-e529621b5515'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.050284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.051148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.051427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.052189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] PATH_INFO: `/v3/projects/9645324ae8ce4797bf3b3a1488580840` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.053224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9645324ae8ce4797bf3b3a1488580840)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.054990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.154987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca1c84b0f0646d0b6d9bfcf4f0ae8e8', 'request_id': 'req-6a4ec71b-5d92-44df-99fd-e529621b5515'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.166748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] The token cache is being invalidate because project aca1c84b0f0646d0b6d9bfcf4f0ae8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:24.167043 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.167795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.169354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1100/2203] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:23 2022] DELETE /identity/v3/projects/aca1c84b0f0646d0b6d9bfcf4f0ae8e8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:24.170118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.171394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.172321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9645324ae8ce4797bf3b3a1488580840', 'request_id': 'req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.178033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9645324ae8ce4797bf3b3a1488580840', 'request_id': 'req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.223376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9645324ae8ce4797bf3b3a1488580840', 'request_id': 'req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.228082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec71b-5d92-44df-99fd-e529621b5515 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.234786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] The token cache is being invalidate because project 9645324ae8ce4797bf3b3a1488580840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:24.235078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.235767 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.237410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1104/2204] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:23 2022] DELETE /identity/v3/projects/9645324ae8ce4797bf3b3a1488580840 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:24.240660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.240660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.279545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.280310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.280604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.280900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.282708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.302584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7177e-6897-42bf-9a5b-0f31e6b2b191 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.308615 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.309481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.309763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.310036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] PATH_INFO: `/v3/users/03cd630d022b4af6b8dca4563f5d6be1` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.311549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cd630d022b4af6b8dca4563f5d6be1)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.313468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.343959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.346031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81275-52fa-45d2-9843-a33f716c203b service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.355186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1101/2205] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:24.356467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95c15-478f-4fb1-b25e-5d2e0e458d80 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.356758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95c15-478f-4fb1-b25e-5d2e0e458d80 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.357078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95c15-478f-4fb1-b25e-5d2e0e458d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.385650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-81a95c15-478f-4fb1-b25e-5d2e0e458d80 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:24.386882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-81a95c15-478f-4fb1-b25e-5d2e0e458d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.395124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1102/2206] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:24.403147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.403442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.403758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.421171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:24.422364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.431332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1103/2207] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:24.435528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.444796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756209-aafd-459c-a763-a2a9730a31f1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.449451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.450368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.450662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.450943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.451696 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:24.452078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.453643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.465333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1104/2208] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:21:24.469503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.480848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba86c0-d77b-426f-b3e8-b5b0d9acbfa3 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.483900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.484623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.484919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.485209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.486012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.487807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.488250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cd630d022b4af6b8dca4563f5d6be1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.488909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cd630d022b4af6b8dca4563f5d6be1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.496514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cd630d022b4af6b8dca4563f5d6be1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.509855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cd630d022b4af6b8dca4563f5d6be1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.583396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cd630d022b4af6b8dca4563f5d6be1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:24.591151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1105/2209] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:24 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:24.593285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1105/2210] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:24 2022] DELETE /identity/v3/users/03cd630d022b4af6b8dca4563f5d6be1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:24.596535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.604184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:24.679713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce22-d54f-4e3a-87b0-9a29778e4c19 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.737054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.737725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.738015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.738294 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.738996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.741528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.817619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1106/2211] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:24 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:24.823047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.832969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f6b55-9203-4972-ab81-bd2ab5c7e4a7 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.838855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.839620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.839908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.840182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.840902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.842498 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.853200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1106/2212] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:24.857276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.866994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3787d3a-ee63-41bd-9ec5-903c009eb2a4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.871684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.872342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.872661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.872936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.873656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.875258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:24.885844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1107/2213] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:24.889952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:24.900266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d29a4-21e2-45c4-a689-1d6d1e69e1ca admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:24.905069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:24.905944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:24.906256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:24.906528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] PATH_INFO: `/v3/projects/7e37d291824c4ac3b81094fd791068ea/users/0830d8757b1a4d978cd9033d0a8445c1/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:24.924366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e37d291824c4ac3b81094fd791068ea, user_id=0830d8757b1a4d978cd9033d0a8445c1, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:24.929245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321ed9-d73f-43d1-9953-6a61b3cfd676 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.013971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.015947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.032346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b272-06ca-4cf1-a444-455f5279933a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.038550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.039314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.039631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.039895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] PATH_INFO: `/v3/projects/e1d901768c514d798358f8e013cb2278` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.041149 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d901768c514d798358f8e013cb2278)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.042974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.048528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1107/2214] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:24 2022] PUT /identity/v3/projects/7e37d291824c4ac3b81094fd791068ea/users/0830d8757b1a4d978cd9033d0a8445c1/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:25.060011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.060318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.060591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.102345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] MFA Rules not processed for user `0830d8757b1a4d978cd9033d0a8445c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:25.104099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.169059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1108/2215] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:25.185588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.187358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.205019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d901768c514d798358f8e013cb2278', 'request_id': 'req-f325337c-988d-4d86-82cd-5307487f233e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:25.211931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d901768c514d798358f8e013cb2278', 'request_id': 'req-f325337c-988d-4d86-82cd-5307487f233e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:25.251821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e289-f6e4-40a5-9dcb-3861cec674b6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.301035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.301718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.301999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.302304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.315641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d901768c514d798358f8e013cb2278', 'request_id': 'req-f325337c-988d-4d86-82cd-5307487f233e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:25.333833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] The token cache is being invalidate because project e1d901768c514d798358f8e013cb2278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:25.334611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:25.335538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f325337c-988d-4d86-82cd-5307487f233e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:25.337987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1108/2216] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:25 2022] DELETE /identity/v3/projects/e1d901768c514d798358f8e013cb2278 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:25.344268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd018-5c44-4b56-b97d-98cfe6b62c61 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.344745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd018-5c44-4b56-b97d-98cfe6b62c61 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.345106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd018-5c44-4b56-b97d-98cfe6b62c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.372320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-759dd018-5c44-4b56-b97d-98cfe6b62c61 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:25.373720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-759dd018-5c44-4b56-b97d-98cfe6b62c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.443400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1109/2217] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:25.452489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.452802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.453082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.473234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:25.474446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.483150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1110/2218] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:25.487270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.497139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02580efd-baf8-4c9a-984b-1874fb2c69f7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.499926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.501575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.502406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.503046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.503325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.503635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.504362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:25.504664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.506264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.511677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1109/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:25.520250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1111/2220] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:21:25.524807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.526946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:25.541558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4a5c-8772-423a-8bb4-8f2ffa9f5f9f service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.546258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.546937 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.547430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.547738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.548434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.550331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.653638 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1110/2221] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:25 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:21:25.657967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.668223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d446-b5c8-431b-87c4-5bc393a2ef2a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.863024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.863785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.864030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.864300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.864989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.866939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:25.961427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1112/2222] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:25 2022] POST /identity/v3/users => generated 280 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:25.965501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:25.976140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9df2-c1a8-4f4d-b595-2a5d2088d698 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:25.980915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:25.981606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:25.981878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:25.982143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:25.982861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:25.985805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:26.008340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1111/2223] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:26.008441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:26.018170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c23da-f4d0-45ab-9dbe-7dffb3a3e4df admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:26.019576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:26.020246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:26.020532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:26.020808 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:26.021547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:26.023724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc167-9272-4c71-85ad-693894e6f863 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:26.035199 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1113/2224] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:26.040228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:26.050537 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab37c8-fdfe-46cd-b212-cf14b5ca4ab4 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:26.056640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:26.057786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:26.058068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:26.058342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] PATH_INFO: `/v3/projects/9feb1aa7ac9a4e459dd8ded39e89d2cf/users/a80cbd80046e4ef0930545edf7f934a6/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:26.074437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feb1aa7ac9a4e459dd8ded39e89d2cf, user_id=a80cbd80046e4ef0930545edf7f934a6, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:26.077213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:26.161097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1112/2225] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:26 2022] PUT /identity/v3/projects/9feb1aa7ac9a4e459dd8ded39e89d2cf/users/a80cbd80046e4ef0930545edf7f934a6/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:26.173964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:26.174355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:26.174730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:26.211916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] MFA Rules not processed for user `a80cbd80046e4ef0930545edf7f934a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:26.213244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:26.317078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1114/2226] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:26.704041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:26.705739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:26.762723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b1b9-cade-4369-8b7d-f4910caf6906 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:26.766897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:26.767605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:26.767894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:26.768168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:26.777633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:26.779329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003874c1-677c-4816-a27d-724b409bc4d0 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:26.793962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1113/2227] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:26 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:26.804716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:26.871186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3182-a339-4fd5-976b-4eb3eddc6835 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:26.876234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:26.877099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:26.877379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:26.877651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] PATH_INFO: `/v3/users/a80cbd80046e4ef0930545edf7f934a6` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:26.878895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80cbd80046e4ef0930545edf7f934a6)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:26.880845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:27.110616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80cbd80046e4ef0930545edf7f934a6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:27.117712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80cbd80046e4ef0930545edf7f934a6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:27.129308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80cbd80046e4ef0930545edf7f934a6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:27.268821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80cbd80046e4ef0930545edf7f934a6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:27.269501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80cbd80046e4ef0930545edf7f934a6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:27.276726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1115/2228] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:26 2022] DELETE /identity/v3/users/a80cbd80046e4ef0930545edf7f934a6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:27.282669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:27.282963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:27.283241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:27.301207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:27.302436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:27.364055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1114/2229] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:27.373159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:27.374580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:27.430342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c19d4c-d3da-461f-906e-b99f6cd66b75 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:27.433959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:27.434607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:27.434891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:27.435170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:27.444552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:27.445989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a51d-fc92-428a-98d5-77683573d45d service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:27.455804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1116/2230] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:28.035686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.038178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:28.051084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dff47-58d3-4533-9b38-a03134cf23b4 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.062411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.063534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.063905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.068863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] PATH_INFO: `/v3/projects/9feb1aa7ac9a4e459dd8ded39e89d2cf` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.068863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9feb1aa7ac9a4e459dd8ded39e89d2cf)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.068863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.201865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9feb1aa7ac9a4e459dd8ded39e89d2cf', 'request_id': 'req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:28.207415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9feb1aa7ac9a4e459dd8ded39e89d2cf', 'request_id': 'req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:28.292053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9feb1aa7ac9a4e459dd8ded39e89d2cf', 'request_id': 'req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:28.303825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] The token cache is being invalidate because project 9feb1aa7ac9a4e459dd8ded39e89d2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:28.304154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:28.305293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-42f2fb3a-925e-4947-82f0-5b5d1b0dbb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:28.306803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1115/2231] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:28 2022] DELETE /identity/v3/projects/9feb1aa7ac9a4e459dd8ded39e89d2cf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:28.311766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268356-094a-4b55-993d-31131d3405ec None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.312270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268356-094a-4b55-993d-31131d3405ec None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.312365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268356-094a-4b55-993d-31131d3405ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.331941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d5268356-094a-4b55-993d-31131d3405ec None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:28.333292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d5268356-094a-4b55-993d-31131d3405ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:28.392838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1117/2232] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:28.401662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.401949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.402224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.420994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:28.422192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:28.435275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1116/2233] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:28.437948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268356-094a-4b55-993d-31131d3405ec None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.448277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268356-094a-4b55-993d-31131d3405ec None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.453395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.457849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.470046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1118/2234] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:21:28.474421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.489165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e11a53-8d93-44a5-8f74-753ae41ca7b2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.494682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.495345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.495667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.495944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.496636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.498524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.574582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1117/2235] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:28 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:28.578758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.590461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2acd17-054c-47f7-9557-4f94aeb035f4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.653280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.654033 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.654367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.654699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.656109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.658087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.795931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1119/2236] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:28 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:28.800012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.810606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3709d4-25b3-48f4-872a-b7777866f290 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.817662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.823086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.823086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.823086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.823086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.823086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.835124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1118/2237] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:28.840273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.852927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6ce51-a00b-46e0-af92-93e44c933ec6 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.858482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.859270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.859655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.860004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.860811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.862705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382eb0-d341-48e3-b842-b0d451ac602a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:28.875012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1120/2238] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:28.881472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:28.893867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ab016-1f65-4d21-a870-45580c988597 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:28.899759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:28.900796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:28.901172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:28.901541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] PATH_INFO: `/v3/projects/d14495b124d146b5a9877abc08957fcc/users/44a12c49eff949ea9cddfefb389bd06c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:28.924148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14495b124d146b5a9877abc08957fcc, user_id=44a12c49eff949ea9cddfefb389bd06c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:28.933806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:29.029983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1119/2239] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:28 2022] PUT /identity/v3/projects/d14495b124d146b5a9877abc08957fcc/users/44a12c49eff949ea9cddfefb389bd06c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:29.035216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:29.035560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:29.035842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:29.053980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:29.055734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:29.114853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1121/2240] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:29.128121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:29.129931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:29.190489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2893c-3aba-48b7-a8ba-05bb0f94fd07 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:29.194441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:29.195058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:29.195364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:29.196344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:29.207098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:29.208570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d634-6817-4a6b-bc47-858d2718d733 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:29.219073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1120/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:29.975393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:29.978736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:29.994428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa9194-6376-4e80-84a5-59f103ec15fe None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:30.004775 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:30.005996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.006586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.008115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] PATH_INFO: `/v3/users/0830d8757b1a4d978cd9033d0a8445c1` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.010349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0830d8757b1a4d978cd9033d0a8445c1)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:30.013307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:30.220620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0830d8757b1a4d978cd9033d0a8445c1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:30.227610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0830d8757b1a4d978cd9033d0a8445c1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:30.240371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0830d8757b1a4d978cd9033d0a8445c1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:30.297125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0830d8757b1a4d978cd9033d0a8445c1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:30.297760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0830d8757b1a4d978cd9033d0a8445c1'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:30.304682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1122/2242] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:29 2022] DELETE /identity/v3/users/0830d8757b1a4d978cd9033d0a8445c1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:30.309994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b9f2-8b7b-4b83-9f91-4efaa7c07161 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.310481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b9f2-8b7b-4b83-9f91-4efaa7c07161 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.310481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583b9f2-8b7b-4b83-9f91-4efaa7c07161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.331358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4583b9f2-8b7b-4b83-9f91-4efaa7c07161 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:30.332914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4583b9f2-8b7b-4b83-9f91-4efaa7c07161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:30.397587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1121/2243] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:21:30.408883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:30.410474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:30.497229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581ab5-4c2c-4c12-95aa-af4d7f52cfce admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:30.506099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:30.506942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.507322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.510065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.520605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:30.522179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:30.534871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1123/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:30.581639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.582220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.582566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.617429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] MFA Rules not processed for user `44a12c49eff949ea9cddfefb389bd06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:30.618846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:30.691720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1122/2245] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:30.703098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:30.704729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:30.765894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306353-6ada-4ad3-b3ae-81ee171b900f service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:30.769727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:30.770587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.770780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.771059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.781877 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:30.783331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70499-807b-49d0-b273-be923bc3e461 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:30.792548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1124/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:30.968814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:30.970304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:30.984305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a7e2-32ce-4024-91a1-d9d05e2bb2ff None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:30.989106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:30.989864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:30.990146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:30.990435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] PATH_INFO: `/v3/projects/7e37d291824c4ac3b81094fd791068ea` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:30.991635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e37d291824c4ac3b81094fd791068ea)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:30.994246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.143681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e37d291824c4ac3b81094fd791068ea', 'request_id': 'req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.149125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e37d291824c4ac3b81094fd791068ea', 'request_id': 'req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.286176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e37d291824c4ac3b81094fd791068ea', 'request_id': 'req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.307149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] The token cache is being invalidate because project 7e37d291824c4ac3b81094fd791068ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:31.307448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.308232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.310159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1123/2247] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:30 2022] DELETE /identity/v3/projects/7e37d291824c4ac3b81094fd791068ea => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:31.315280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0e54-43c7-4130-96ce-66c11deca3ac None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.315784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0e54-43c7-4130-96ce-66c11deca3ac None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.315902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0e54-43c7-4130-96ce-66c11deca3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.338507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b80e0e54-43c7-4130-96ce-66c11deca3ac None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:31.338507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b80e0e54-43c7-4130-96ce-66c11deca3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.378130 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.379655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.411523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1125/2248] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:31.419346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.419729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.420082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.441714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:31.442970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.454590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1126/2249] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:31.455507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.464763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52b68-16ad-4ef1-9d1b-d77d9fa09d8c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.465269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca6e0-a3c1-4d1a-842d-2ba4ad7f5d77 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.469469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.470121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.470401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.470504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.470693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.471269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.471411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:31.471578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.471718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.472126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] PATH_INFO: `/v3/users/da8f46cb0f6b45379cc546a643b88b6c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.473379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.473514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8f46cb0f6b45379cc546a643b88b6c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.475403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.489397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1127/2250] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:21:31.491334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.519031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e97aaa-7728-4145-94e7-12ba64d7f10a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.524058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.524741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.525023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.525329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.531864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.531864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.613140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1128/2251] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:31 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:31.615495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.688672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ba3a-b651-4d57-82dc-683821b88a72 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.691379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8f46cb0f6b45379cc546a643b88b6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.692139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8f46cb0f6b45379cc546a643b88b6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.694795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.695660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.696075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.696472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.697254 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.699324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.699620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8f46cb0f6b45379cc546a643b88b6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.711944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8f46cb0f6b45379cc546a643b88b6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.796401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-8e9dc2c5-0e85-49eb-92fd-9777f5f7b979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8f46cb0f6b45379cc546a643b88b6c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:31.805682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1124/2252] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:31 2022] DELETE /identity/v3/users/da8f46cb0f6b45379cc546a643b88b6c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:31.806038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1129/2253] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:31 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:31.807073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.807424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.807875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.808336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.809529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.822634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33d0b-2df0-4274-b0a0-7adf7a4b46bd admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.826714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:31.828044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.889557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.890247 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.890536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.890741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1125/2254] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:31.891155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.892028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.894248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.903863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.905955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1130/2255] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:31.906708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:31.910236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.920931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed929-f847-4d2e-80f0-23897393aaa5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.928936 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.929702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.929985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.930256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.931012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.932640 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.943611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1131/2256] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:31.947700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:31.957571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04532-bb10-4618-bd7f-538489b7a43d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.963173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.964100 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.964400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.964702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] PATH_INFO: `/v3/projects/9f1d3453b828467abbadb99e2bc0ed3f/users/2ca6928f72744fb0a2419dbd2489a5f8/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.972880 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b60a7-5179-44d8-8ed0-f9875f513dc2 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:31.978483 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:31.979144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:31.979423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:31.979724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:31.985364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1d3453b828467abbadb99e2bc0ed3f, user_id=2ca6928f72744fb0a2419dbd2489a5f8, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.990249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:31.993416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:31.997667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a5701-1737-43f8-a861-ff57d77793cb service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:32.006953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1126/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:21:32.078362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1132/2258] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:31 2022] PUT /identity/v3/projects/9f1d3453b828467abbadb99e2bc0ed3f/users/2ca6928f72744fb0a2419dbd2489a5f8/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:32.089144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:32.089431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:32.089721 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:32.118142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] MFA Rules not processed for user `2ca6928f72744fb0a2419dbd2489a5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:32.119560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:32.186741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1127/2259] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:32.194829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:32.197081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:32.255592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c151-9bc2-481e-84f6-3e8ab17267bf admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:32.260156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:32.260803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:32.261082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:32.261375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:32.271343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:32.271343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73f23f-6990-45ba-b25e-dfb325b54133 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:32.281485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1133/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:32.595145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:32.598155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:32.619333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:32.619869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:32.620072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:32.643994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] MFA Rules not processed for user `44a12c49eff949ea9cddfefb389bd06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:32.645155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:32.715251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc45d6-57b9-4451-999a-e3e17a66c611 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:32.718960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1134/2261] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:32.720753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:32.721897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:32.722403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:32.722877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] PATH_INFO: `/v3/projects/e0edf81a743b4ac7b223e4d9bb398788` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:32.731920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0edf81a743b4ac7b223e4d9bb398788)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:32.734084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:32.863971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0edf81a743b4ac7b223e4d9bb398788', 'request_id': 'req-ac857da3-6c6f-4b1c-a039-bb98c980c26e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:32.876983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0edf81a743b4ac7b223e4d9bb398788', 'request_id': 'req-ac857da3-6c6f-4b1c-a039-bb98c980c26e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:32.949248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0edf81a743b4ac7b223e4d9bb398788', 'request_id': 'req-ac857da3-6c6f-4b1c-a039-bb98c980c26e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:32.961773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] The token cache is being invalidate because project e0edf81a743b4ac7b223e4d9bb398788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:32.962155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:32.962883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:32.964816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1128/2262] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:32 2022] DELETE /identity/v3/projects/e0edf81a743b4ac7b223e4d9bb398788 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:32.968739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:32.984768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd317-d86b-4082-a359-f0d47397d3e7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:33.091299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:33.091299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:33.091299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:33.091299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] PATH_INFO: `/v3/users/e8b926bb51ba495dbf2e9107b07fa19a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:33.091773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b926bb51ba495dbf2e9107b07fa19a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:33.093912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:33.248163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b926bb51ba495dbf2e9107b07fa19a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:33.254792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b926bb51ba495dbf2e9107b07fa19a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:33.268191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b926bb51ba495dbf2e9107b07fa19a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:33.332120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b926bb51ba495dbf2e9107b07fa19a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:33.332750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2d6c5cfc-e2b0-434b-a73e-7824a638ed5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b926bb51ba495dbf2e9107b07fa19a'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:33.339867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1135/2263] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:21:32 2022] DELETE /identity/v3/users/e8b926bb51ba495dbf2e9107b07fa19a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:33.881679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:33.883235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:33.900759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857da3-6c6f-4b1c-a039-bb98c980c26e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:33.956497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:33.957343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:33.957619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:33.957886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] PATH_INFO: `/v3/projects/166e00207f3d4f20a25426475ffb79e4` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:33.959106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166e00207f3d4f20a25426475ffb79e4)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:33.961088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:34.103488 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166e00207f3d4f20a25426475ffb79e4', 'request_id': 'req-6a166daa-8700-4395-9b35-2c1938887f58'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:34.119375 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166e00207f3d4f20a25426475ffb79e4', 'request_id': 'req-6a166daa-8700-4395-9b35-2c1938887f58'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:34.189531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166e00207f3d4f20a25426475ffb79e4', 'request_id': 'req-6a166daa-8700-4395-9b35-2c1938887f58'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:34.206062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] The token cache is being invalidate because project 166e00207f3d4f20a25426475ffb79e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:21:34.206422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:34.207301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6a166daa-8700-4395-9b35-2c1938887f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:21:34.210052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1129/2264] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:21:33 2022] DELETE /identity/v3/projects/166e00207f3d4f20a25426475ffb79e4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:21:34.216947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.217447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.218023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.239745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:34.242059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:34.309521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1136/2265] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:34.317351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.317766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.318046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.335926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:34.337643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:34.345812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1130/2266] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:34.349840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:34.363351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9089c9-a351-43f6-982a-412c61148632 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:34.364441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:34.365082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.365361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.365633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.366355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:21:34.366746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:34.368383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:34.379595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1137/2267] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:21:34.384362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:34.393596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aa786-54d4-4521-9f01-acb4230b0af8 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:34.398349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:34.399050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.399330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.400256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.400956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:34.403083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:34.754585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1131/2268] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:21:34 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:34.771063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:34.781342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba903-315f-4c99-8450-02d77232ed26 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:34.854757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:34.855647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.856098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.856519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.857244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:34.867880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:34.972513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1138/2269] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:21:34 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:21:34.976466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:34.987366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6595a-be46-4c9d-8eca-8592e082825f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:34.994830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:34.995741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:34.996231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:34.996708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:34.997496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:34.999193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:35.010244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1132/2270] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:21:35.017911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:35.028830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050000d-c604-426c-96cf-915d3f5cd26a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:35.033434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:35.037901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:35.037901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:35.037901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:35.037901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:35.037901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3f97-cd8a-4611-98fe-23e0ab799b36 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:35.050654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1139/2271] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:21:35.051720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:35.062359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423953a8-8153-4aee-b56f-c99841c78a6f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:35.066902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:35.067990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:35.068269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:35.068544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] PATH_INFO: `/v3/projects/4f8b8086198643e7ab8bf7c91361f106/users/8f1d1d23ad3b4eac9c84bbdf8c433f5a/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:35.083043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8b8086198643e7ab8bf7c91361f106, user_id=8f1d1d23ad3b4eac9c84bbdf8c433f5a, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:35.085728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:35.243385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1133/2272] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:21:35 2022] PUT /identity/v3/projects/4f8b8086198643e7ab8bf7c91361f106/users/8f1d1d23ad3b4eac9c84bbdf8c433f5a/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:21:35.256722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:35.257219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:35.257219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:35.284754 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] MFA Rules not processed for user `8f1d1d23ad3b4eac9c84bbdf8c433f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:35.285946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:35.355744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1140/2273] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:35.366903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:35.368955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:35.434395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372c9b-ae9b-4b26-b29a-24b56c48e834 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:35.439013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:35.439713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:35.440003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:35.440281 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:35.453768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:35.455222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889d1c-db42-4182-aa3d-500c09122ddb service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:35.465657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1134/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:35.649384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:35.650810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:35.709716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4101726-af63-4f90-8385-3ec3d3c0a57d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:35.713989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:35.714635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:35.715114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:35.715215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:35.716998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:35.778267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:35.779735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e35e-d73e-4937-af76-80ccfbeb1c79 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:35.789290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1141/2275] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:21:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:21:40.487737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2bb2-1e33-49d2-82db-5a5ffe6a4def None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:40.488207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2bb2-1e33-49d2-82db-5a5ffe6a4def None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:40.488299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2bb2-1e33-49d2-82db-5a5ffe6a4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:40.505920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-695f2bb2-1e33-49d2-82db-5a5ffe6a4def None None] MFA Rules not processed for user `4c69d1709721460eb77784d0f468c9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:40.507106 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-695f2bb2-1e33-49d2-82db-5a5ffe6a4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:40.559848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1135/2276] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:56.802711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:56.803251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:56.803486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:56.821205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] MFA Rules not processed for user `88c132a4d80d40cd810b5d5b0eeda77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:56.822906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:56.875797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1142/2277] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:59.448315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:59.448881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:59.448881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:59.514205 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:21:59.515379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:59.597864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1136/2278] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:21:59.645250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:21:59.646804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:21:59.782196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54de8-204a-4c06-bc14-86b2d88b2b47 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:21:59.787406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:21:59.788098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:21:59.788375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:21:59.793786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:21:59.802253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:21:59.804286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693fce3-9644-44bb-89b3-63774f1488e7 service swift] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:21:59.814018 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1143/2279] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:22:03.493716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:03.600739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc9d61-7dce-456a-860d-96076e458b64 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:03.610324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:03.611340 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:03.611656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:03.611933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] PATH_INFO: `/v3/users/8f1d1d23ad3b4eac9c84bbdf8c433f5a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:03.613171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1d1d23ad3b4eac9c84bbdf8c433f5a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:03.615101 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:03.958817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1d1d23ad3b4eac9c84bbdf8c433f5a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:03.962442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1d1d23ad3b4eac9c84bbdf8c433f5a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:03.980873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1d1d23ad3b4eac9c84bbdf8c433f5a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:04.007152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1d1d23ad3b4eac9c84bbdf8c433f5a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:04.131456 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1d1d23ad3b4eac9c84bbdf8c433f5a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:04.150208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1137/2280] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:22:03 2022] DELETE /identity/v3/users/8f1d1d23ad3b4eac9c84bbdf8c433f5a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:04.155272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaebf3c-640f-4743-8175-07e62ebfa52c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:04.156352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaebf3c-640f-4743-8175-07e62ebfa52c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:04.156871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaebf3c-640f-4743-8175-07e62ebfa52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:04.212830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dfaebf3c-640f-4743-8175-07e62ebfa52c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:04.214532 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dfaebf3c-640f-4743-8175-07e62ebfa52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:04.370888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1144/2281] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:04.381013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:04.382622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:04.471047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0459-70d3-4f65-be0a-e306cb22c1f1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:04.477695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:04.478724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:04.479163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:04.479620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:04.490800 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:04.492823 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:04.506680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1138/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:04.558151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b67cc-4d72-44ea-a7ac-971e0dae88b1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:04.558823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b67cc-4d72-44ea-a7ac-971e0dae88b1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:04.560125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b67cc-4d72-44ea-a7ac-971e0dae88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:04.591404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-869b67cc-4d72-44ea-a7ac-971e0dae88b1 None None] MFA Rules not processed for user `44a12c49eff949ea9cddfefb389bd06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:04.594473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-869b67cc-4d72-44ea-a7ac-971e0dae88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:04.719777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1145/2283] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:05.737912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:05.737912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:05.783243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145da8-b1f0-4faf-a47c-1d04af30ccf4 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:05.801627 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:05.802613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:05.802883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:05.803319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] PATH_INFO: `/v3/projects/4f8b8086198643e7ab8bf7c91361f106` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:05.804745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8b8086198643e7ab8bf7c91361f106)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:05.806863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:05.953599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8b8086198643e7ab8bf7c91361f106', 'request_id': 'req-68a19e02-fa62-4902-8268-2c68eca7799b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:05.960789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8b8086198643e7ab8bf7c91361f106', 'request_id': 'req-68a19e02-fa62-4902-8268-2c68eca7799b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:06.057798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8b8086198643e7ab8bf7c91361f106', 'request_id': 'req-68a19e02-fa62-4902-8268-2c68eca7799b'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:06.102785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] The token cache is being invalidate because project 4f8b8086198643e7ab8bf7c91361f106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:22:06.103081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:06.103993 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-68a19e02-fa62-4902-8268-2c68eca7799b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:06.105751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1139/2284] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:22:05 2022] DELETE /identity/v3/projects/4f8b8086198643e7ab8bf7c91361f106 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:06.110797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.111446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.111446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.144238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:06.164270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:06.265156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1146/2285] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:06.272870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.273154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.273429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.294315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:06.295580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:06.316794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.323216 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1140/2286] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:06.336119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2caa-4f51-433e-b3f0-fc8ecb157502 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.341942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.342863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.343502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.343960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.344896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:22:06.345394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.347191 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.366995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1147/2287] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:22:06.372582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.403290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11482-5850-463b-95e7-dc158d85e930 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.427669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.428363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.428644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.428919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.429902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.432113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.550780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1141/2288] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:22:06 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:22:06.557160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.568920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52798-7202-4d28-bbce-5488e52ece26 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.666469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.667185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.667643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.667938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.668651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.670907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.751978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1148/2289] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:22:06 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:06.757213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.768914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eefed-7315-4f22-a586-fd4bdfd89ea8 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.774970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.775905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.777298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.777298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.777595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.780620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.799535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1142/2290] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:06.803996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.823900 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d6fd7-c04e-41f2-9133-b42966a736ea admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.828798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.829478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.829766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.830046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.830986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.832994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1f0a4-d5ec-4df5-9a38-25d2a74d6090 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.862152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1149/2291] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:06.866451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:06.878533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1448ab-f985-44cb-bcb2-3ff14042546b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:06.895681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:06.896895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:06.897223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:06.897503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] PATH_INFO: `/v3/projects/70a91c00feb54af48e117a81b2965838/users/3b7abf68d67346158f192ef3ce1a0199/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:06.916523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a91c00feb54af48e117a81b2965838, user_id=3b7abf68d67346158f192ef3ce1a0199, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:06.920905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:06.990084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1143/2292] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:22:06 2022] PUT /identity/v3/projects/70a91c00feb54af48e117a81b2965838/users/3b7abf68d67346158f192ef3ce1a0199/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:07.006979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41020-427a-4f25-b037-da5e2525542d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:07.007269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41020-427a-4f25-b037-da5e2525542d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:07.007571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41020-427a-4f25-b037-da5e2525542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:07.078216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-10a41020-427a-4f25-b037-da5e2525542d None None] MFA Rules not processed for user `3b7abf68d67346158f192ef3ce1a0199`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:07.080227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-10a41020-427a-4f25-b037-da5e2525542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:07.158210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1150/2293] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:07.164169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:07.296371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08eec7-4e5c-4f61-8d05-4228ff1143ab admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:07.301680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:07.302273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:07.302566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:07.302846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:07.303667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:07.305666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:07.758672 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1144/2294] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:07.771371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41020-427a-4f25-b037-da5e2525542d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:07.784545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41020-427a-4f25-b037-da5e2525542d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:07.874705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:07.875404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:07.875723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:07.875991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:07.876907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:07.878955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:07.967663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1151/2295] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:22:07 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:07.975144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.006769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe3e8-5ef3-4400-81ed-6490cbbae5f4 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.028864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.029643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.029926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.031595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.032466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.034149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.052599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1145/2296] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:08.056700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.080945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec403-303a-411e-b871-2edd1ecb8373 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.086793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.088272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.088632 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.089007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.089830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.091910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddc03-5730-494f-88eb-d80e4f7bba33 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.107817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1152/2297] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:08.111914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.122033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161ed1-3cfb-4f7b-bdf4-5518741df3d3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.129104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.130322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.130869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.131358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] PATH_INFO: `/v3/projects/dd97ba227e704d73a8de5d78df749b3f/users/d56753f16e914c5eb905c8960b12a6c6/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.150391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd97ba227e704d73a8de5d78df749b3f, user_id=d56753f16e914c5eb905c8960b12a6c6, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.153155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.232203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1146/2298] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:22:08 2022] PUT /identity/v3/projects/dd97ba227e704d73a8de5d78df749b3f/users/d56753f16e914c5eb905c8960b12a6c6/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:08.244174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.244930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.245749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.297776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] MFA Rules not processed for user `d56753f16e914c5eb905c8960b12a6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:08.300057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:08.393903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1153/2299] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:08.398422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.469867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbae17-eac5-4fe7-bc9f-8e218131dc9f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.475105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.475830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.476114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.476395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.477103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.479677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.593685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1147/2300] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:22:08 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:08.597430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.609340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ec9d-2e44-41f0-8824-c306df02ea68 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.673387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.674078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.674363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.674639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.675345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.677331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.780380 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1154/2301] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:22:08 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:08.786481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.798190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255fe8d-c41d-45f7-8608-5ef6bc838bd9 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.805816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.806716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.807099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.807563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.808561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.811432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.831464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1148/2302] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:22:08.832766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:08.859602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32967393-0ba3-40ce-8ddf-974ea9a6e667 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:08.867724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:08.869796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:08.870813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:08.871310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] PATH_INFO: `/v3/projects/42561a1cef894d768565aa81e3ae5059/users/f87479413ae740dcb3170725ab6db679/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:08.908564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42561a1cef894d768565aa81e3ae5059, user_id=f87479413ae740dcb3170725ab6db679, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:08.911564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:08.996206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1155/2303] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:22:08 2022] PUT /identity/v3/projects/42561a1cef894d768565aa81e3ae5059/users/f87479413ae740dcb3170725ab6db679/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:09.001410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:09.014502 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82063-4250-4859-a457-ce2197ab2459 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:09.125810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:09.126652 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:09.127035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:09.127581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:09.128511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:09.135524 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d47bc-6c85-4684-98e0-1383b1923fbe admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:09.155345 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1149/2304] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:09.159383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:09.175955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1373f-387c-43dd-aad1-e96d9bd2820d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:09.191927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:09.192854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:09.193137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:09.193413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] PATH_INFO: `/v3/projects/42561a1cef894d768565aa81e3ae5059/users/f87479413ae740dcb3170725ab6db679/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:09.195452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42561a1cef894d768565aa81e3ae5059, user_id=f87479413ae740dcb3170725ab6db679, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:09.198773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:09.222078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1156/2305] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:22:09 2022] PUT /identity/v3/projects/42561a1cef894d768565aa81e3ae5059/users/f87479413ae740dcb3170725ab6db679/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:09.244251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:09.244570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:09.244829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:09.282261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] MFA Rules not processed for user `f87479413ae740dcb3170725ab6db679`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:09.285508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:09.392740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1150/2306] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:22:09.404881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:09.407868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:09.522449 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c9b5d-8195-4272-adad-a5464de35001 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:09.537507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:09.538180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:09.538466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:09.538743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:09.636800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:09.638324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:09.652839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1157/2307] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:12.130675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:12.167830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a28ca-1a54-4ecf-90ad-1ec896bfd105 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:12.173641 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:12.174272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:12.174554 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:12.174828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:12.249107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:12.251746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:12.262470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1151/2308] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:13.908168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:13.916779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e87c4-35e8-4a27-94a8-965208625f6b service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:13.920494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:13.921137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:13.921445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:13.921759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:13.931423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:13.932888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7378a-ea39-43a0-81e4-f2bac13f4d04 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:13.942480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1158/2309] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:18.743177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:18.823569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfe5e7-8c1b-45e2-9264-5fa0254596bc service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:18.823569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:18.824330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:18.824712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:18.825092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] PATH_INFO: `/v3/users/3b7abf68d67346158f192ef3ce1a0199` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:18.826520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7abf68d67346158f192ef3ce1a0199)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:18.829889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:19.024861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7abf68d67346158f192ef3ce1a0199'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.025517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7abf68d67346158f192ef3ce1a0199'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.032603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7abf68d67346158f192ef3ce1a0199'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.044013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7abf68d67346158f192ef3ce1a0199'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.132236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7abf68d67346158f192ef3ce1a0199'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.139179 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1152/2310] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:22:18 2022] DELETE /identity/v3/users/3b7abf68d67346158f192ef3ce1a0199 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:19.143756 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:19.144215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:19.144306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:19.162157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:19.165667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:19.225507 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1159/2311] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:19.235388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:19.236857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:19.299440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffc6d-8fb0-4c07-a386-8b06aafaabe2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:19.303043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:19.303895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:19.304173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:19.304437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:19.314356 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:19.315818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab7a71-a3be-4a2c-b099-50d9cfe5bcda service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:19.326004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1153/2312] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:19.800727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:19.802704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:19.816408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fd0e7-6855-4cec-86a9-7accdfeaca2c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:19.821218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:19.822780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:19.823067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:19.823368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] PATH_INFO: `/v3/projects/70a91c00feb54af48e117a81b2965838` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:19.824699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a91c00feb54af48e117a81b2965838)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:19.826483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:19.955181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a91c00feb54af48e117a81b2965838', 'request_id': 'req-e344622c-dfa4-4811-be47-ecc165b7c666'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:19.960751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a91c00feb54af48e117a81b2965838', 'request_id': 'req-e344622c-dfa4-4811-be47-ecc165b7c666'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.046043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0d2e-ae10-4005-993d-c1d646c09a8d None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.047171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a91c00feb54af48e117a81b2965838', 'request_id': 'req-e344622c-dfa4-4811-be47-ecc165b7c666'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.047317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0d2e-ae10-4005-993d-c1d646c09a8d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.047317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0d2e-ae10-4005-993d-c1d646c09a8d None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.049349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1154/2313] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:22:20.064232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.064555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.064849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.068749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] The token cache is being invalidate because project 70a91c00feb54af48e117a81b2965838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:22:20.069316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.070657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.074362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1160/2314] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:22:19 2022] DELETE /identity/v3/projects/70a91c00feb54af48e117a81b2965838 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:20.079562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:20.084986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.144578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:20.146848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.218940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344622c-dfa4-4811-be47-ecc165b7c666 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:20.225092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:20.226216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.226503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.226930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] PATH_INFO: `/v3/users/d56753f16e914c5eb905c8960b12a6c6` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.228847 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56753f16e914c5eb905c8960b12a6c6)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:20.230963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:20.251047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1155/2315] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:20.263958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:20.265348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.343552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc1eb-ab98-47da-8df7-3762c19d72e1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:20.348123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:20.348801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.349080 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.349359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.360888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:20.362354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba8813-6156-4b38-a4da-01ffb3d25eb0 service glance] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:20.373680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1156/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:22:20.409029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56753f16e914c5eb905c8960b12a6c6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.416610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56753f16e914c5eb905c8960b12a6c6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.428120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56753f16e914c5eb905c8960b12a6c6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.514326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56753f16e914c5eb905c8960b12a6c6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.515008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1907b537-7d0b-44e2-842e-d7cbdf4b9ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56753f16e914c5eb905c8960b12a6c6'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:20.521325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1161/2317] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:22:20 2022] DELETE /identity/v3/users/d56753f16e914c5eb905c8960b12a6c6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:20.596843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.597250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.597601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] PATH_INFO: `/` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.599167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1157/2318] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 08:22:20.605209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93b34-b976-4f9f-bce8-8480bb64f740 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.605498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93b34-b976-4f9f-bce8-8480bb64f740 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.605779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93b34-b976-4f9f-bce8-8480bb64f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.623906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a9d93b34-b976-4f9f-bce8-8480bb64f740 None None] MFA Rules not processed for user `0561d7ef7b45441fb6b39aed78cf7921`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:20.625107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a9d93b34-b976-4f9f-bce8-8480bb64f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.675044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1162/2319] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:22:20.686999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:20.688748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.701628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfed3d1-11e1-4210-a388-772726eb899a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:20.705208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:20.705847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.706121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.706394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.714549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:20.715860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ed7b-ef07-4b81-aeaf-be5b566fe24e service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:20.724321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1158/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:20.829162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4668c-bcfe-4756-9505-748cc9db551e None None] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.829413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4668c-bcfe-4756-9505-748cc9db551e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.829871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4668c-bcfe-4756-9505-748cc9db551e None None] PATH_INFO: `/` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.831660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1163/2321] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 12 08:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 08:22:20.838786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.839223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.839829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.859085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] MFA Rules not processed for user `2c961d005e574c10a93f9a876ac7ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:20.860472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.926062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1159/2322] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 12 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:20.939713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4668c-bcfe-4756-9505-748cc9db551e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:20.944609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:20.948373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:20.955177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4668c-bcfe-4756-9505-748cc9db551e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:20.959530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:20.970548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:20.971448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:20.972350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:20.985480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:20.987004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:20.998865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1164/2323] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:21.026309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24e483-30d0-4c46-8b03-8d3c606ca90f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:21.033941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:21.034811 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:21.035093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:21.035377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] PATH_INFO: `/v3/projects/dd97ba227e704d73a8de5d78df749b3f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:21.036620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd97ba227e704d73a8de5d78df749b3f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:21.038541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:21.165021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd97ba227e704d73a8de5d78df749b3f', 'request_id': 'req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.173629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd97ba227e704d73a8de5d78df749b3f', 'request_id': 'req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.228934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd97ba227e704d73a8de5d78df749b3f', 'request_id': 'req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.244759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] The token cache is being invalidate because project dd97ba227e704d73a8de5d78df749b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:22:21.245306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.246629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.251873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1160/2324] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:22:20 2022] DELETE /identity/v3/projects/dd97ba227e704d73a8de5d78df749b3f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:21.253228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:21.268964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2367f0-b2dd-41a3-9976-a23e69579fdb service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:21.372978 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:21.374013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:21.374367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:21.374655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] PATH_INFO: `/v3/users/f87479413ae740dcb3170725ab6db679` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:21.378951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87479413ae740dcb3170725ab6db679)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:21.382848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:21.609521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87479413ae740dcb3170725ab6db679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.616949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87479413ae740dcb3170725ab6db679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.629412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87479413ae740dcb3170725ab6db679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.716112 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87479413ae740dcb3170725ab6db679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.716677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87479413ae740dcb3170725ab6db679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:21.723665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1165/2325] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:22:21 2022] DELETE /identity/v3/users/f87479413ae740dcb3170725ab6db679 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:22:22.265121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:22.267086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:22.282358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659943d8-5ef6-4c2e-8443-0a1db7eb7acc admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:22.342093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:22.342987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:22.343265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:22.343572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] PATH_INFO: `/v3/projects/42561a1cef894d768565aa81e3ae5059` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:22.344865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] RBAC: Authorizing `identity:delete_project(project_id=42561a1cef894d768565aa81e3ae5059)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:22.346776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:22.445731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42561a1cef894d768565aa81e3ae5059', 'request_id': 'req-2ea15140-ee6c-4de6-9ea0-0417b53b17da'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:22.463357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42561a1cef894d768565aa81e3ae5059', 'request_id': 'req-2ea15140-ee6c-4de6-9ea0-0417b53b17da'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:22.545048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42561a1cef894d768565aa81e3ae5059', 'request_id': 'req-2ea15140-ee6c-4de6-9ea0-0417b53b17da'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:22.567962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] The token cache is being invalidate because project 42561a1cef894d768565aa81e3ae5059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:22:22.568329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:22.569830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2ea15140-ee6c-4de6-9ea0-0417b53b17da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:22.573695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1161/2326] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:22:22 2022] DELETE /identity/v3/projects/42561a1cef894d768565aa81e3ae5059 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:23.984676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:23.986484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:24.002223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bc8e0-4b3d-427e-a6c8-ecdb432cf364 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:24.060589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:24.061613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:24.061895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:24.062166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] PATH_INFO: `/v3/users/2ca6928f72744fb0a2419dbd2489a5f8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:24.063351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca6928f72744fb0a2419dbd2489a5f8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:24.065291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:24.264565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca6928f72744fb0a2419dbd2489a5f8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:24.272094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca6928f72744fb0a2419dbd2489a5f8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:24.284961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca6928f72744fb0a2419dbd2489a5f8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:24.361128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca6928f72744fb0a2419dbd2489a5f8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:24.361797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca6928f72744fb0a2419dbd2489a5f8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:24.369121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1166/2327] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:22:23 2022] DELETE /identity/v3/users/2ca6928f72744fb0a2419dbd2489a5f8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:24.373735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c009c8-3999-46de-b4e4-1d50ff229127 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:24.374206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c009c8-3999-46de-b4e4-1d50ff229127 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:24.374289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c009c8-3999-46de-b4e4-1d50ff229127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:24.393357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-56c009c8-3999-46de-b4e4-1d50ff229127 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:24.393724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-56c009c8-3999-46de-b4e4-1d50ff229127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:24.453653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1162/2328] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:24.463771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:24.465194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:24.520358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df46a6f-2a48-423b-a837-5c30b4835bdf admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:24.523981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:24.525156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:24.525437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:24.525710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:24.534943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:24.536417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:24.546322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1167/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:24.874894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:24.875181 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:24.884146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:24.893902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:24.895119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:24.950451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1163/2330] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:24.962561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:24.964186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:24.997072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:24.998671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:25.015133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882aba-def2-4666-b123-a9a5856b4d98 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.024777 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.026828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.027187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.027670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] PATH_INFO: `/v3/projects/9f1d3453b828467abbadb99e2bc0ed3f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.029252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1d3453b828467abbadb99e2bc0ed3f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.031715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.041441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4d498-06e4-442b-8a19-5c157ac501c6 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.050109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.051027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.051371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.051868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.061923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.063603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd571f-5864-48a1-b0a1-6737e6768fbe service swift] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.072190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1168/2331] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:22:25.127046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1d3453b828467abbadb99e2bc0ed3f', 'request_id': 'req-155fcc76-369e-4011-93c2-2852cbbb2d01'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:25.132493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1d3453b828467abbadb99e2bc0ed3f', 'request_id': 'req-155fcc76-369e-4011-93c2-2852cbbb2d01'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:25.194946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1d3453b828467abbadb99e2bc0ed3f', 'request_id': 'req-155fcc76-369e-4011-93c2-2852cbbb2d01'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:25.207666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] The token cache is being invalidate because project 9f1d3453b828467abbadb99e2bc0ed3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:22:25.207961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:25.208664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-155fcc76-369e-4011-93c2-2852cbbb2d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:22:25.210832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1164/2332] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:22:24 2022] DELETE /identity/v3/projects/9f1d3453b828467abbadb99e2bc0ed3f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:22:25.215829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.216122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.216422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.249516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:25.250795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:25.341959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1169/2333] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:25.349568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576aca2-3854-442d-a997-f893650c776d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.350052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576aca2-3854-442d-a997-f893650c776d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.350377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576aca2-3854-442d-a997-f893650c776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.374998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8576aca2-3854-442d-a997-f893650c776d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:25.377398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8576aca2-3854-442d-a997-f893650c776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:25.392612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1165/2334] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:25.393287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.405649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd614d-78bc-48d6-91e7-44f6b96a618b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.412086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.413720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.414282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.415520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.416574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:22:25.417211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.419314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.439422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1170/2335] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:22:25.440224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576aca2-3854-442d-a997-f893650c776d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.450742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576aca2-3854-442d-a997-f893650c776d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.457406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.458466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.458998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.459703 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.460723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.463145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.567441 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1166/2336] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:22:25 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:25.573077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.586295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261751f-bc28-4d0b-97f1-03e393c73938 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.696051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.696799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.697088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.697365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.698105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.700116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.793106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1171/2337] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:22:25 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:22:25.797142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.810838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a61db-52cd-4d31-80d9-f5b5d9594d24 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.815588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.816244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.816610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.817926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.817926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.819395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.833705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1167/2338] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:22:25.835168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.845670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de29d-b513-4a09-9f21-05b02eb69906 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.850543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.851302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.851690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.852038 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.853469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.855136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2c7e7-4c4a-455e-8660-436de9a7b221 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.865327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1172/2339] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:22:25.869629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:25.879233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e401-c901-4e73-b263-54c502f6282d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:25.884644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:25.889991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:25.889991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:25.889991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] PATH_INFO: `/v3/projects/c98388e0b299435da8a911f3d4a9c797/users/848ba301608b4b11b68dc7befb57ad77/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:25.912548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98388e0b299435da8a911f3d4a9c797, user_id=848ba301608b4b11b68dc7befb57ad77, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:25.916288 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:25.990359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1168/2340] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:22:25 2022] PUT /identity/v3/projects/c98388e0b299435da8a911f3d4a9c797/users/848ba301608b4b11b68dc7befb57ad77/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:22:26.002413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e82d-8e26-43b7-8e4c-3d3e10496219 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:26.002760 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e82d-8e26-43b7-8e4c-3d3e10496219 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:26.002985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e82d-8e26-43b7-8e4c-3d3e10496219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:26.052888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e358e82d-8e26-43b7-8e4c-3d3e10496219 None None] MFA Rules not processed for user `848ba301608b4b11b68dc7befb57ad77`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:26.055392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e358e82d-8e26-43b7-8e4c-3d3e10496219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:26.140502 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1173/2341] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:26.152180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:26.154430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:26.220026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942711-ef06-49ab-a774-f9497412e0ee admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:26.223778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:26.224499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:26.224786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:26.225066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:26.234986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:26.236487 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:26.245900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1169/2342] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:27.932935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c16bc5-6740-4bbf-871e-815313e26658 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:27.933409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c16bc5-6740-4bbf-871e-815313e26658 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:27.933503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c16bc5-6740-4bbf-871e-815313e26658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:27.951607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b2c16bc5-6740-4bbf-871e-815313e26658 None None] MFA Rules not processed for user `848ba301608b4b11b68dc7befb57ad77`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:27.952818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b2c16bc5-6740-4bbf-871e-815313e26658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:27.959655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1174/2343] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:36.505941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:36.507421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:36.600543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d224-d00f-4817-bba5-bbe4bc3fd78d service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:36.606593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:36.607253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:36.607568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:36.609513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:36.609889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:36.621593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:36.623175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:36.632963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1170/2344] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:22:51.543088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068fe74-5cc9-44cd-9238-fdf86dc0057f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:51.543674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068fe74-5cc9-44cd-9238-fdf86dc0057f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:51.543779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068fe74-5cc9-44cd-9238-fdf86dc0057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:51.561557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9068fe74-5cc9-44cd-9238-fdf86dc0057f None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:51.562977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9068fe74-5cc9-44cd-9238-fdf86dc0057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:51.617070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1175/2345] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:22:51.629266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:51.630685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:51.695912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d290-aaec-4aee-abdf-d6de4f2000f8 service placement] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:51.701388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:51.702028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:51.702314 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:51.702592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:51.710300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:51.711900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:51.720270 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1171/2346] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:22:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:22:52.403661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c05-11ee-4678-a129-91421cfebe4b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:52.404151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c05-11ee-4678-a129-91421cfebe4b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:52.404870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c05-11ee-4678-a129-91421cfebe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:52.429972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f42f8c05-11ee-4678-a129-91421cfebe4b None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:22:52.431820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f42f8c05-11ee-4678-a129-91421cfebe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:22:52.453611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1176/2347] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:22:52.467010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:22:52.481668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043f7f-a2d9-497a-8835-abd73a04cc98 service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:22:52.488853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:22:52.493869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:22:52.493869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:22:52.493869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:22:52.500228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:22:52.501905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:22:52.511491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1172/2348] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:03.238089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc91b-f989-4523-aa94-46647670cac3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:03.238944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc91b-f989-4523-aa94-46647670cac3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:03.239370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc91b-f989-4523-aa94-46647670cac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:03.263346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7debc91b-f989-4523-aa94-46647670cac3 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:03.265800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7debc91b-f989-4523-aa94-46647670cac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:03.275579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1177/2349] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:23:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:03.343808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:03.364058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4ea1b-b9c5-48ad-b74b-8f316ac1b6eb service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:03.380262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:03.381927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:03.382460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:03.382961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:03.401402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:03.405429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:03.421309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1173/2350] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:23:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:05.171524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05591-a630-43ce-834d-0a34ddac1a01 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:05.172422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05591-a630-43ce-834d-0a34ddac1a01 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:05.172856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05591-a630-43ce-834d-0a34ddac1a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:05.205655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-cdb05591-a630-43ce-834d-0a34ddac1a01 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:05.207644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-cdb05591-a630-43ce-834d-0a34ddac1a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:05.224722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1178/2351] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:23:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:05.237048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:05.250654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884fa5-e924-486f-b648-84ea51aef613 service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:05.256653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:05.257568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:05.258020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:05.261286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:05.268407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:05.270254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:05.281776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1174/2352] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:23:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:05.954096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89c44-6638-4f89-b4ba-15a3549ed103 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:05.954869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89c44-6638-4f89-b4ba-15a3549ed103 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:05.960724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89c44-6638-4f89-b4ba-15a3549ed103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:05.982463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0be89c44-6638-4f89-b4ba-15a3549ed103 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:05.984586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0be89c44-6638-4f89-b4ba-15a3549ed103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:05.995070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1179/2353] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:23:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:06.019458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:06.036689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7294-3e59-49b5-84ca-e352da9b948c service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:06.043629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:06.045267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:06.045625 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:06.045976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:06.061057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:06.062990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:06.073008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1175/2354] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:23:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:06.851309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:06.851830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:06.851958 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:06.872726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:06.875466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:06.884076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1180/2355] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:23:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:06.899051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:06.910293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8cc4-71cc-4761-bf7d-b3894e58fa45 service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:06.915538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:06.916257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:06.916772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:06.917640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:06.926530 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:06.928223 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59634a89-ad9b-49c3-97ac-42e0e38bf243 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:06.937039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1176/2356] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:23:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:09.600990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:09.663986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31920d87-60b2-4842-8b22-42c305d4557d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:09.668952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:09.669814 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:09.670097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:09.670377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] PATH_INFO: `/v3/users/848ba301608b4b11b68dc7befb57ad77` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:09.671648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=848ba301608b4b11b68dc7befb57ad77)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:09.673493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:09.837543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848ba301608b4b11b68dc7befb57ad77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:09.845020 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848ba301608b4b11b68dc7befb57ad77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:09.857049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848ba301608b4b11b68dc7befb57ad77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:09.902945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:09.903346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:09.903653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:09.908701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848ba301608b4b11b68dc7befb57ad77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:09.909404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-ecdc12a0-3582-41be-9dbc-eca526c43ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848ba301608b4b11b68dc7befb57ad77'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:09.918745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1181/2357] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:23:09 2022] DELETE /identity/v3/users/848ba301608b4b11b68dc7befb57ad77 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:09.921614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:09.921974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:09.922193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:09.930916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:09.932753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:09.942472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:09.943751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:10.001560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1177/2358] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:23:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:23:10.012201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1182/2359] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:10.018576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:10.020254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:10.020736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:10.022214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:10.084430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbcf31-39d6-48f3-b598-78da6e003900 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:10.090382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:10.090382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:10.090382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:10.090382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:10.100827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb46d-e02e-4b1c-a8e5-35cbda7fa086 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:10.106319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:10.107032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:10.107713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:10.107946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:10.108064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:10.108246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:10.117059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:10.118195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1183/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:23:10.118773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:10.128252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1178/2361] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:23:10.338121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:10.339794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:10.356796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefbe2c-76a0-4fd5-a6c0-bb76d4d22971 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:10.362676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:10.363151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:10.363573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:10.363937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] PATH_INFO: `/v3/projects/c98388e0b299435da8a911f3d4a9c797` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:10.365960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98388e0b299435da8a911f3d4a9c797)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:10.368309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:10.485271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98388e0b299435da8a911f3d4a9c797', 'request_id': 'req-09094162-76f1-4af4-9c99-fd08d15a3444'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:10.490441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98388e0b299435da8a911f3d4a9c797', 'request_id': 'req-09094162-76f1-4af4-9c99-fd08d15a3444'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:10.553104 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98388e0b299435da8a911f3d4a9c797', 'request_id': 'req-09094162-76f1-4af4-9c99-fd08d15a3444'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:10.587762 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] The token cache is being invalidate because project c98388e0b299435da8a911f3d4a9c797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:23:10.588126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:10.590552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:10.604323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1184/2362] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:23:10 2022] DELETE /identity/v3/projects/c98388e0b299435da8a911f3d4a9c797 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:13.216755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:13.218207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:13.232389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6151d-c698-44ae-8443-da76bd85204b service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:13.289618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:13.290506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:13.290775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:13.291052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] PATH_INFO: `/v3/users/44a12c49eff949ea9cddfefb389bd06c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:13.292315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a12c49eff949ea9cddfefb389bd06c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:13.294326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:13.500078 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a12c49eff949ea9cddfefb389bd06c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:13.500836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a12c49eff949ea9cddfefb389bd06c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:13.507458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a12c49eff949ea9cddfefb389bd06c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:13.518686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a12c49eff949ea9cddfefb389bd06c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:13.583116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-052db546-e566-4f8c-b591-a0b890a58f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a12c49eff949ea9cddfefb389bd06c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:13.591780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1179/2363] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:23:13 2022] DELETE /identity/v3/users/44a12c49eff949ea9cddfefb389bd06c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:13.842246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:13.843815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:13.864168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094162-76f1-4af4-9c99-fd08d15a3444 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:13.924221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:13.925083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:13.925372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:13.925651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] PATH_INFO: `/v3/projects/d14495b124d146b5a9877abc08957fcc` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:13.926975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14495b124d146b5a9877abc08957fcc)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:13.928915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.039059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14495b124d146b5a9877abc08957fcc', 'request_id': 'req-4add56b4-67a5-4587-b773-273d86f74465'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:14.044435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14495b124d146b5a9877abc08957fcc', 'request_id': 'req-4add56b4-67a5-4587-b773-273d86f74465'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:14.125916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14495b124d146b5a9877abc08957fcc', 'request_id': 'req-4add56b4-67a5-4587-b773-273d86f74465'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:14.137979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] The token cache is being invalidate because project d14495b124d146b5a9877abc08957fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:23:14.138265 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:14.138895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-4add56b4-67a5-4587-b773-273d86f74465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:14.140469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1185/2364] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:23:13 2022] DELETE /identity/v3/projects/d14495b124d146b5a9877abc08957fcc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:14.146392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.146679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.146963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.170316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:14.171646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:14.229844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1180/2365] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:14.237780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.238126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.238412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.256623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:14.257823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:14.266310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1186/2366] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:14.270500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.280940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb360d5-250f-4615-a360-751eab5d1c36 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.285698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.286347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.286634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.287024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.287791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:23:14.288094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.294533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.304339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1181/2367] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:23:14.305530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.314690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ba53-f516-4e36-b4a2-59e602efb0da None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.319392 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.320063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.320347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.320621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.323194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.323194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.413726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1187/2368] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:23:14 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:23:14.417706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.428137 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0a173-27b7-494b-b513-2ad911618acd admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.484024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.484705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.484988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.485266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.485968 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.487926 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.588058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1182/2369] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:23:14 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:23:14.592268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.602481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24d07-7f70-4e52-8739-de4cb319664a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.607967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.611577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.611577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.611577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.611577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.611577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.623298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1188/2370] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:23:14.627211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.637998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6160-34c9-426f-824a-5c49f0604c6b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.642731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.643500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.643802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.644077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.644796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.646384 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4ac6-5a15-4461-a366-6311c88dca7d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.656493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1183/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:23:14.660559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.670244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549d439-7825-4b59-82ed-49476c180cef admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.674837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.675726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.676006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.676279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] PATH_INFO: `/v3/projects/18d6a0b8aad948658c16849648256527/users/0f4c7cd341d14b4a895aa6a97e362304/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.691016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d6a0b8aad948658c16849648256527, user_id=0f4c7cd341d14b4a895aa6a97e362304, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.694910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.771822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1189/2372] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:23:14 2022] PUT /identity/v3/projects/18d6a0b8aad948658c16849648256527/users/0f4c7cd341d14b4a895aa6a97e362304/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:14.782463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f14b-453c-40fb-989f-9b94eb29d09c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.782751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f14b-453c-40fb-989f-9b94eb29d09c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.783054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f14b-453c-40fb-989f-9b94eb29d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.811897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f5d3f14b-453c-40fb-989f-9b94eb29d09c None None] MFA Rules not processed for user `0f4c7cd341d14b4a895aa6a97e362304`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:14.812492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f5d3f14b-453c-40fb-989f-9b94eb29d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:14.874659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1184/2373] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:14.892207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:14.893899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:14.951272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6cbf-f34c-42f6-9fd8-8aba6df4c815 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:14.954961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:14.955649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:14.955952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:14.956212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:14.964330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:14.965836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127810-5ee8-467f-b9bb-95bd956dac27 service glance] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:14.974398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1190/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:23:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:23:16.253992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:16.254744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:16.254744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:16.272545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] MFA Rules not processed for user `4c69d1709721460eb77784d0f468c9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:16.273774 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:16.333601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1185/2375] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:40.783878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc088f-6290-4345-b3d0-e360a2fa289e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:40.784438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc088f-6290-4345-b3d0-e360a2fa289e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:40.784438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc088f-6290-4345-b3d0-e360a2fa289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:40.801313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-8ebc088f-6290-4345-b3d0-e360a2fa289e None None] MFA Rules not processed for user `88c132a4d80d40cd810b5d5b0eeda77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:40.802497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8ebc088f-6290-4345-b3d0-e360a2fa289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:40.855147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1191/2376] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:49.850788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:49.931854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e967b14-3e16-4c5b-afa0-6c70a397d602 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:49.941435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:49.942529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:49.948264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:49.948264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] PATH_INFO: `/v3/users/0f4c7cd341d14b4a895aa6a97e362304` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:49.948264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4c7cd341d14b4a895aa6a97e362304)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:49.948264 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:50.214699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4c7cd341d14b4a895aa6a97e362304'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:50.215369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4c7cd341d14b4a895aa6a97e362304'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:50.223706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4c7cd341d14b4a895aa6a97e362304'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:50.237624 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4c7cd341d14b4a895aa6a97e362304'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:50.308692 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4c7cd341d14b4a895aa6a97e362304'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:50.316965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1186/2377] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:23:49 2022] DELETE /identity/v3/users/0f4c7cd341d14b4a895aa6a97e362304 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:50.323779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:50.325318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:50.325318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:50.357060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:50.360084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:50.436012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1192/2378] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:50.448374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:50.449957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:50.521200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854613cf-73d2-4082-aa57-4266a8426993 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:50.528155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:50.529007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:50.532875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:50.533633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:50.552163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:50.554010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f8d92-c56a-4644-8f44-5d93f431bd80 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:50.569373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1187/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:23:51.361344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:51.363970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:51.380859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7b4a-ea28-48c4-a377-2ac45cd476fe None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:51.387305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:51.388837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:51.389158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:51.389437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] PATH_INFO: `/v3/projects/18d6a0b8aad948658c16849648256527` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:51.390645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d6a0b8aad948658c16849648256527)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:51.393412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:51.538223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d6a0b8aad948658c16849648256527', 'request_id': 'req-a353eba3-23e5-4703-a70a-e8c0f493b77b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:51.544551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d6a0b8aad948658c16849648256527', 'request_id': 'req-a353eba3-23e5-4703-a70a-e8c0f493b77b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:51.616461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d6a0b8aad948658c16849648256527', 'request_id': 'req-a353eba3-23e5-4703-a70a-e8c0f493b77b'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:51.628962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] The token cache is being invalidate because project 18d6a0b8aad948658c16849648256527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:23:51.629249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:51.629933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a353eba3-23e5-4703-a70a-e8c0f493b77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:23:51.631454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1193/2380] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:23:51 2022] DELETE /identity/v3/projects/18d6a0b8aad948658c16849648256527 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:23:51.637334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:51.637779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:51.637939 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:51.656996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:51.658192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:51.719622 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1188/2381] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:51.727522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:51.728015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:51.728299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:51.747706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:51.748949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:51.757368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1194/2382] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:51.762377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:51.772798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b941f-d0ae-4032-a54d-5cc486858084 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:51.778515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:51.779244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:51.779626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:51.779966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:51.781013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:23:51.781381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:51.782982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:51.799558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1189/2383] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:23:51.804541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:51.828427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e1cbc-9bfe-4a7b-8232-8174c52eb07a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:51.834192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:51.834930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:51.835214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:51.835943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:51.836647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:51.839361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:51.968148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1195/2384] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:23:51.972291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:51.982865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b762ce-2c11-4ce3-b57d-1e7747e545ba admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:52.042389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:52.043204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.043414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.043723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.044417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:52.047440 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:52.159485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1190/2385] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:23:51 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:23:52.163764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:52.174411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dbf08-6a6c-4016-bb19-0f767b446817 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:52.178980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:52.179669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.179964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.180512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.181703 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:52.183309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:52.193973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1196/2386] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:23:52.198083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:52.208350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc79b51-d5b2-42cf-a80f-7c7e0cbc4f25 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:52.213043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:52.214206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.214568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.214841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.215657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:52.217249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e625fd-f830-4e39-84bf-ee6e075953c6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:52.227548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1191/2387] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:23:52.232394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:52.245740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdf752-abd6-4cbc-bd67-2fa053fab604 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:52.247364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:52.248272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.248555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.248829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] PATH_INFO: `/v3/projects/363e74209dea4f4cb1a53e9d32f43f7e/users/afe446553c7f4926b3ce94039109a24d/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.263907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=363e74209dea4f4cb1a53e9d32f43f7e, user_id=afe446553c7f4926b3ce94039109a24d, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:52.268810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50242a-e19b-406c-be14-5e606a6effdb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:52.323915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1197/2388] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:23:52 2022] PUT /identity/v3/projects/363e74209dea4f4cb1a53e9d32f43f7e/users/afe446553c7f4926b3ce94039109a24d/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:23:52.329224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e5f3-41d0-4eee-8db9-b812aceab1ce None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.329696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e5f3-41d0-4eee-8db9-b812aceab1ce None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.330046 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e5f3-41d0-4eee-8db9-b812aceab1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.338957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.339822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.339822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.351338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9511e5f3-41d0-4eee-8db9-b812aceab1ce None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:52.353326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9511e5f3-41d0-4eee-8db9-b812aceab1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:52.357967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] MFA Rules not processed for user `14313ce3f35f4468add7fbc073f90f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:52.359314 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:52.418036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1198/2389] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:52.426243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1192/2390] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:52.437128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:52.438557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:52.503347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3d5fd-f92b-4f3f-a8de-34d28cd29bac None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:52.507397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:52.508082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:52.508509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:52.508821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:52.519015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:52.520539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c88ce-8e67-47b0-b11d-983f2f35e88f service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:23:52.530946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1199/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:23:54.276895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:54.277443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:54.277443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:54.295588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] MFA Rules not processed for user `ad2204eb50114552898320fcdb5577d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:54.296808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:54.353943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1193/2392] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:59.799040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:59.799569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:59.799666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:59.838995 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] MFA Rules not processed for user `afe446553c7f4926b3ce94039109a24d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:23:59.841031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:23:59.924197 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1200/2393] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:23:59.928248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:23:59.940557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d62fc-e220-4a1b-8e4a-8be1cfdec283 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:23:59.945644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:23:59.949909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:23:59.949909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:23:59.949909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:23:59.949909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:23:59.951144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.071553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1194/2394] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:23:59 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:24:00.077668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:00.088747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8a0c-356e-4bc2-a768-4ea269d7f2b0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:00.165482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:00.166192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:00.166484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:00.166758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:00.167451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:00.169635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.281387 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1201/2395] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:24:00 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:24:00.281854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:00.293316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f6f31-f90b-4c00-a6f5-7f1b2fd15171 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:00.305867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:00.308138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:00.308138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:00.308138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:00.308138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:00.309580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.321924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1195/2396] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:24:00.326993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:00.341879 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2ff1-c8da-4e0c-becb-13ccc1599b0d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:00.346736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:00.347691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:00.347986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:00.349061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] PATH_INFO: `/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e/users/4e31716f7a9c41afa356414a1bd65bda/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:00.365175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f37e9b3f6c4b468cc0251cdb77040e, user_id=4e31716f7a9c41afa356414a1bd65bda, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:00.368210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.452321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1202/2397] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:24:00 2022] PUT /identity/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e/users/4e31716f7a9c41afa356414a1bd65bda/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:24:00.456426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:00.466924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519fd09-a29d-431d-b003-811441ced723 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:00.554869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:00.555684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:00.555973 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:00.556254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:00.557714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:00.561026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e36fb-dd50-44e8-8dab-5be8a51adb14 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.572938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1196/2398] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:24:00.577300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:00.589924 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b39e-1678-4e4a-a6cb-83a4e92b33e6 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:00.597036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:00.598225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:00.598557 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:00.599258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] PATH_INFO: `/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e/users/4e31716f7a9c41afa356414a1bd65bda/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:00.601470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f37e9b3f6c4b468cc0251cdb77040e, user_id=4e31716f7a9c41afa356414a1bd65bda, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:00.604714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:00.615950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1203/2399] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:24:00 2022] PUT /identity/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e/users/4e31716f7a9c41afa356414a1bd65bda/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:24:07.105621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2868a-0e8a-4e86-9990-d34425e62462 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:07.105621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2868a-0e8a-4e86-9990-d34425e62462 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:07.105621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2868a-0e8a-4e86-9990-d34425e62462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:07.123837 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ebd2868a-0e8a-4e86-9990-d34425e62462 None None] MFA Rules not processed for user `4e31716f7a9c41afa356414a1bd65bda`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:24:07.125074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ebd2868a-0e8a-4e86-9990-d34425e62462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:07.221352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1197/2400] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:24:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:24:07.229985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:07.233676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:07.331718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0b81-fa30-4ade-bac8-0cd938893ddf admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:07.339659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:07.340597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:07.341085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:07.341573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:07.410131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:07.411649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:07.422950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1204/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:07.715426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f279a1-a67c-43a8-ae58-3b3f91d705aa None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:07.718701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f279a1-a67c-43a8-ae58-3b3f91d705aa None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:07.718701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f279a1-a67c-43a8-ae58-3b3f91d705aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:07.736728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b9f279a1-a67c-43a8-ae58-3b3f91d705aa None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:24:07.737970 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b9f279a1-a67c-43a8-ae58-3b3f91d705aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:07.800109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1198/2402] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:24:07.840794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:07.851268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:07.971825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b780a2-5976-40cf-8413-dbf408449861 service glance] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:07.981493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:07.982589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:07.983071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:07.983403 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:07.995021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:07.999322 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d45d2-f074-4675-a46e-1a173267fd83 service swift] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:08.009174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1205/2403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:24:19.955328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:19.955922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:19.955922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:19.973684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] MFA Rules not processed for user `afe446553c7f4926b3ce94039109a24d`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:24:19.974808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:19.981720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1199/2404] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:24:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:24:25.131293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:25.132428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:25.132875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:25.160010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:24:25.161929 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:25.182067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1206/2405] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:24:25.189905 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:25.205155 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e7859-19c0-4e52-aea9-a8094ec5bf28 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:25.210942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:25.212053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:25.212526 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:25.212941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:25.223938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:25.225614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:25.234953 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1200/2406] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:24:34.013763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:34.069110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558837-9199-4158-982a-19a5c0ff526b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:34.073032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:34.073751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:34.074035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:34.074312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:34.076098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:34.150361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:34.152476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:34.164968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1207/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:35.371661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:35.373626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:35.395496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469307-e3c4-4724-96a6-b921923f6b4f service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:35.399209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:35.401148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:35.401425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:35.401697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:35.403544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:35.420501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:35.422299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064387-3a9c-4b9c-b38e-8a2f4edbebb1 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:35.435156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1201/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:38.668806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:38.670297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:38.684482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3fa4-1ed2-47ad-ae85-7cb869d96be4 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:38.690022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:38.690668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:38.690969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:38.691232 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:38.693024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:38.751812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:38.753321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:38.763031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1208/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:43.765209 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:43.765742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:43.765742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:43.784317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] MFA Rules not processed for user `4c69d1709721460eb77784d0f468c9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:24:43.785499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:43.792862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1202/2410] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:24:44.678413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:44.680192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:44.748968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743785-eb7b-47fb-a003-84001e62fa89 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:44.753984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:44.754626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:44.754905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:44.755211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:44.757025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:44.769794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:44.771509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:44.784360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1209/2411] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:48.458011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:48.459351 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:48.475316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc00a6-7947-41ac-915b-55c101542b76 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:48.480796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:48.481430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:48.481713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:48.481986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:48.483725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:48.540254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:48.541828 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:48.550509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1203/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:49.200304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:49.211227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910812c7-10fa-46c1-a8bd-958ceaa3e30f service placement] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:49.215910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:49.216740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:49.217022 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:49.217302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:49.219067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:49.227812 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:49.229561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:49.231542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:49.237206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf7844-cc2a-4643-9dfa-bdfb9646f66c service nova] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:49.241824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:49.241824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:49.242128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:49.242415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:49.247315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1210/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:49.250378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:49.252001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:49.264815 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1204/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:24:50.464175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:50.477154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ff96-f000-4690-bbe2-94606fcf3ba5 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:50.484668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:50.489261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:50.489261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:50.489261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:50.489261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:50.550955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:50.553750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:50.568074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1211/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:24:58.974806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:24:58.983829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4bea-7a63-4769-bba7-e4563b2b720f service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:24:58.987395 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:24:58.988053 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:24:58.988333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:24:58.988633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:24:58.990350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:24:59.050320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:24:59.051775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:24:59.061884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1205/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:04.596393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:04.598050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:04.616124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191257-fec8-4c27-9253-b3f390aa0f45 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:04.621551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:04.622635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:04.622914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:04.623188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] PATH_INFO: `/v3/users/88c132a4d80d40cd810b5d5b0eeda77e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:04.624404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c132a4d80d40cd810b5d5b0eeda77e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:04.626478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:04.783854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c132a4d80d40cd810b5d5b0eeda77e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:04.790563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c132a4d80d40cd810b5d5b0eeda77e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:04.804046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c132a4d80d40cd810b5d5b0eeda77e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:04.854795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c132a4d80d40cd810b5d5b0eeda77e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:04.855417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c132a4d80d40cd810b5d5b0eeda77e'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:04.862054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1212/2417] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:25:04 2022] DELETE /identity/v3/users/88c132a4d80d40cd810b5d5b0eeda77e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:25:05.142536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.151718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bf13-90f0-448c-b248-5c377b678cb7 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.166420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.167951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:05.237152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.237152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.237152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.237152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.237961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:05.252395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9481b-f004-4f58-8f42-c72e53c53ed1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.257296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.258153 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.258438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.258719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] PATH_INFO: `/v3/projects/7411cb7c422c426da8dcf9ba38515373` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.260041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7411cb7c422c426da8dcf9ba38515373)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.261945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.302765 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.304221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9818f-e75d-4e58-9b7c-1352e496aa91 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.314242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1206/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:05.393833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7411cb7c422c426da8dcf9ba38515373', 'request_id': 'req-65a0c186-85ba-49d2-832a-4105bffe2b2c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:05.399997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7411cb7c422c426da8dcf9ba38515373', 'request_id': 'req-65a0c186-85ba-49d2-832a-4105bffe2b2c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:05.479800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7411cb7c422c426da8dcf9ba38515373', 'request_id': 'req-65a0c186-85ba-49d2-832a-4105bffe2b2c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:05.491102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] The token cache is being invalidate because project 7411cb7c422c426da8dcf9ba38515373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:25:05.491391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:05.492063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-65a0c186-85ba-49d2-832a-4105bffe2b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:25:05.494118 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1213/2419] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:25:05 2022] DELETE /identity/v3/projects/7411cb7c422c426da8dcf9ba38515373 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:25:05.499120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.499407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.499711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.518324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:05.519630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:05.577858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1207/2420] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:05.585831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.586124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.586408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.604381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:05.605598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:05.614698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1214/2421] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:05.620928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.635182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796008-d321-491e-91d7-dd161c4d7cde None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.641339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.642003 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.642285 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.642557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.643279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:25:05.643628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.645220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.657562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1208/2422] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:25:05.662002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.672227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2dfb-0be2-4205-9a39-dcb4e146d724 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.676898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.677582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.677886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.678165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.678883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.680864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.773542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1215/2423] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:25:05 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:25:05.775317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.785287 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d26499-ff9b-4a8b-ba3b-a68ce70f18d0 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.840043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.840697 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.840977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.841251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.841921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.843909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.934621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1209/2424] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:25:05 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:25:05.935537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.946291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c24eb-d47f-440d-a8fc-d653eae6cd69 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.951919 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.952584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.952870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.957280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.957280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.957280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:05.967013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1216/2425] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:25:05.971065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:05.981761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be153fe-42b8-455d-857c-d667dc8cf6ac admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:05.986707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:05.987391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:05.987699 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:05.987977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:05.988706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:05.990324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b97b9f-8df2-4a88-8e35-1b1c00785627 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:06.005359 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1210/2426] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:25:06.006621 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:06.019541 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3141c-ec51-436f-b273-e495261dc5fe admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:06.025965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:06.027349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:06.027909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:06.028335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] PATH_INFO: `/v3/projects/e4cb80aa86f846cabcbee099dd90a3ca/users/b02cccd87bde482c98218ee27bf8facf/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:06.050361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cb80aa86f846cabcbee099dd90a3ca, user_id=b02cccd87bde482c98218ee27bf8facf, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:06.054852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:06.125493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1217/2427] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:25:06 2022] PUT /identity/v3/projects/e4cb80aa86f846cabcbee099dd90a3ca/users/b02cccd87bde482c98218ee27bf8facf/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:25:06.130549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:06.130846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:06.131123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:06.148311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:06.151682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:06.209239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1211/2428] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:06.219457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:06.221226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:06.282942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6978d1-11cf-4a3e-8a2b-2c8ec293aa59 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:06.286797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:06.287597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:06.287980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:06.288377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:06.298399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:06.299973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:06.310236 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1218/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:07.674238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:07.675739 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:07.756551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b350e-d9b9-4870-9640-2eaaa89b6e5d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:07.765497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:07.766529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:07.766991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:07.767923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:07.770222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:07.788747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:07.790394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be162-9947-4c3e-8f76-61296a8ada0b service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:07.801975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1212/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:11.690937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:11.692483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:11.724263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c836-7f25-45d3-a5da-a6dd031c7f72 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:11.740421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:11.741454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:11.741915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:11.742573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:11.749248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:11.780798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:11.782711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:11.814121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1219/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:12.387568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a08503-8fe4-4317-ac45-1b73f0de3d07 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:12.389789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a08503-8fe4-4317-ac45-1b73f0de3d07 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:12.390295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a08503-8fe4-4317-ac45-1b73f0de3d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:12.449795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e5a08503-8fe4-4317-ac45-1b73f0de3d07 None None] MFA Rules not processed for user `b02cccd87bde482c98218ee27bf8facf`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:12.451497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e5a08503-8fe4-4317-ac45-1b73f0de3d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:12.534298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1213/2432] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:25:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:12.547008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:12.559671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad54c9-ea14-4fae-87ed-9ef583e60f9f service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:12.566075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:12.566949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:12.567830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:12.568241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:12.577303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:12.579174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:12.605623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1220/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:15.108764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dce6-eb3e-4fb5-a9ad-b44fd76642ed None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:15.111910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dce6-eb3e-4fb5-a9ad-b44fd76642ed None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:15.112191 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dce6-eb3e-4fb5-a9ad-b44fd76642ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:15.134789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9642dce6-eb3e-4fb5-a9ad-b44fd76642ed None None] MFA Rules not processed for user `b02cccd87bde482c98218ee27bf8facf`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:15.139159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9642dce6-eb3e-4fb5-a9ad-b44fd76642ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:15.144182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1214/2434] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:25:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:15.632874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:15.635246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:15.646954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75447-c5d1-4be8-ab5e-5ef7a59359e2 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:15.650671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:15.651320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:15.651646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:15.651921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:15.653859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:15.664214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:15.666174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:15.674902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1221/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:19.343639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:19.344490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:19.344879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:19.373557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:19.376082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:19.464566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1215/2436] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:19.488231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:19.491021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:19.597237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526fe0e-2a2c-4534-aa71-fc2929f01638 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:19.620188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:19.623304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:19.623304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:19.623304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:19.633741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:19.635620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f467b4-e116-4033-8356-35a4a06e2f2a service swift] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:19.644529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1222/2437] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:25:21.061749 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:21.077390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1143-dba9-4391-8a71-5659e5c2e623 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:21.083275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:21.084220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:21.084551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:21.084986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:21.088439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:21.103263 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:21.105357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:21.117816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1216/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:25:38.586200 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202594d4-172a-44fe-a716-ba09c8081a36 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:38.586744 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202594d4-172a-44fe-a716-ba09c8081a36 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:38.586865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202594d4-172a-44fe-a716-ba09c8081a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:38.604227 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-202594d4-172a-44fe-a716-ba09c8081a36 None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:38.605509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-202594d4-172a-44fe-a716-ba09c8081a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:38.612785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1223/2439] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 12 08:25:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:38.625266 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:38.636669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f8e7-f86a-4ce2-a4b3-33a400f28577 service nova] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:38.641528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:38.642159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:38.642439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:38.642711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:38.650864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:38.652580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:38.660807 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1217/2440] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:25:54.718071 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:54.718596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:54.718596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:54.737327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:25:54.738548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:54.746513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1224/2441] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:25:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:25:54.758696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:54.769210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009cc3d-e2f0-4029-b33e-92cab59ab483 service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:54.774203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:54.774826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:54.775105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:54.775377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:54.784316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:54.785884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2010-7ce2-4f19-b1f5-ef19dd28fcc9 service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:54.794410 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1218/2442] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 08:25:56.881074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:25:56.882832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:56.944296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a793c1-d865-4825-a58c-7b19134e213c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:25:56.948420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:25:56.949057 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:25:56.949337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:25:56.949609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:25:56.951343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:25:57.008551 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:25:57.009991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:25:57.019528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1225/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:25:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:26:05.591207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:05.591776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:05.591776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:05.613476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] MFA Rules not processed for user `14313ce3f35f4468add7fbc073f90f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:05.614748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:05.623174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1219/2444] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:13.392725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:13.401854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e708bea-8fd8-473b-82a2-b0a6996caf79 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:13.405605 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:13.406309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:13.406594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:13.406871 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:13.409010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:13.421493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:13.422911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:13.432836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1226/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:17.287935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:17.289464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:17.304546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ad7-6e32-4daa-8472-466ab4e16c74 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:17.309197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:17.310060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:17.310342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:17.310617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] PATH_INFO: `/v3/users/4c69d1709721460eb77784d0f468c9ec` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:17.311853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c69d1709721460eb77784d0f468c9ec)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:17.313780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:17.474914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c69d1709721460eb77784d0f468c9ec'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:17.475603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c69d1709721460eb77784d0f468c9ec'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:17.483398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c69d1709721460eb77784d0f468c9ec'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:17.495016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c69d1709721460eb77784d0f468c9ec'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:17.598715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c95aa79b-46f2-4f09-8fda-62fbbc3b7e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c69d1709721460eb77784d0f468c9ec'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:17.598715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1220/2446] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:26:17 2022] DELETE /identity/v3/users/4c69d1709721460eb77784d0f468c9ec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:17.862763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:17.872971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702ffc9-5ae1-4bc2-9cff-398cfb5d8463 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:17.929029 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:17.929881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:17.930160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:17.930432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] PATH_INFO: `/v3/projects/06a4436df3ad431ea8a69e4d1a53c216` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:17.931619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a4436df3ad431ea8a69e4d1a53c216)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:17.933549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.078614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a4436df3ad431ea8a69e4d1a53c216', 'request_id': 'req-9a5b427f-34ec-43a8-9af4-4a676547f2e4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:18.084035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a4436df3ad431ea8a69e4d1a53c216', 'request_id': 'req-9a5b427f-34ec-43a8-9af4-4a676547f2e4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:18.147319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a4436df3ad431ea8a69e4d1a53c216', 'request_id': 'req-9a5b427f-34ec-43a8-9af4-4a676547f2e4'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:18.158636 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] The token cache is being invalidate because project 06a4436df3ad431ea8a69e4d1a53c216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:26:18.158925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:18.159599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9a5b427f-34ec-43a8-9af4-4a676547f2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:18.161136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1227/2447] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:26:17 2022] DELETE /identity/v3/projects/06a4436df3ad431ea8a69e4d1a53c216 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:18.166094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.166387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.166657 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.185268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:18.186437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:18.247759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1221/2448] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:18.257082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.257082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.257082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.274820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:18.276078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:18.284526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1228/2449] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:18.289012 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.301709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9527-efb0-47d8-88ad-2353f93775b6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.308220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.308901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.309187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.309532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.310620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:26:18.310935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.312644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.325365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1222/2450] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:26:18.329771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.338850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b21d-7621-48ed-a884-0e85d4f0fb82 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.344219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.348975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.348975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.348975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.348975 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.349347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.460620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1229/2451] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:26:18 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:18.464817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.476109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f4bbf-6367-45ea-a837-f758c48a2465 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.531120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.531847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.532134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.532413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.533364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.535329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.645882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1223/2452] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:26:18 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:18.647350 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.657277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c29c24-e5fc-4a5f-8d05-63159fe5abeb admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.662305 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.662960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.663244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.663552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.664331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.665926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.676329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1230/2453] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:26:18.680262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.699066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b805c-f2cd-4bc9-93e3-ec218c8f9d13 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.703710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.704360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.704639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.704909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.705619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.707210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d0ad-14d3-4094-885b-f036372fb112 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.717286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1224/2454] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:26:18.721175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.731542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948f81-0db1-42d5-951a-fa25328ab48b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:18.736096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:18.736961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.737244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.737549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] PATH_INFO: `/v3/projects/ba3fb93041464e8baf9e4fcebd832b2c/users/d7dac017b9d14f4d8e5f5187dc9aa1d0/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.751574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fb93041464e8baf9e4fcebd832b2c, user_id=d7dac017b9d14f4d8e5f5187dc9aa1d0, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:18.754262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:18.876474 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1231/2455] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:26:18 2022] PUT /identity/v3/projects/ba3fb93041464e8baf9e4fcebd832b2c/users/d7dac017b9d14f4d8e5f5187dc9aa1d0/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:18.886604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:18.887664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:18.887664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:18.915414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] MFA Rules not processed for user `d7dac017b9d14f4d8e5f5187dc9aa1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:18.916669 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:18.977791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1225/2456] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:18.989819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:18.991921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:19.064035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c95e8-65fe-4bb7-bd67-fde32ce2f0e1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:19.069645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:19.070297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:19.070581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:19.070854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:19.079230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:19.080875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c18c3-688d-4069-af6e-0d0d034b6077 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:19.090054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1232/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:19.265148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:19.326154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adbb2-f6d4-4b69-9e30-0b66ac578115 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:19.330679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:19.331557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:19.331839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:19.332112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] PATH_INFO: `/v3/users/d7dac017b9d14f4d8e5f5187dc9aa1d0` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:19.333304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dac017b9d14f4d8e5f5187dc9aa1d0)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:19.335224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:19.518991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dac017b9d14f4d8e5f5187dc9aa1d0'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:19.519617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dac017b9d14f4d8e5f5187dc9aa1d0'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:19.526418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dac017b9d14f4d8e5f5187dc9aa1d0'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:19.537996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dac017b9d14f4d8e5f5187dc9aa1d0'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:19.613655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dac017b9d14f4d8e5f5187dc9aa1d0'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:19.619826 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1226/2458] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:26:19 2022] DELETE /identity/v3/users/d7dac017b9d14f4d8e5f5187dc9aa1d0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:19.624887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:19.625364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:19.625653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:19.643397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:19.644608 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:19.703406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1233/2459] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:19.712874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:19.714268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:19.775916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755692-8ac3-404b-b3dd-a23113b77bd6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:19.780448 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:19.781111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:19.781392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:19.781666 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:19.796017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:19.796017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73626cfe-cf5c-4185-a814-079e641ef2d8 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:19.807217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1227/2460] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:20.228923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.231061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:20.244009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1bc0-cbcc-41e8-8d85-71ed45ca6e98 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.248798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.249685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.249970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.250248 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] PATH_INFO: `/v3/projects/ba3fb93041464e8baf9e4fcebd832b2c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.251457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3fb93041464e8baf9e4fcebd832b2c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.253408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.374730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3fb93041464e8baf9e4fcebd832b2c', 'request_id': 'req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:20.380048 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3fb93041464e8baf9e4fcebd832b2c', 'request_id': 'req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:20.438139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3fb93041464e8baf9e4fcebd832b2c', 'request_id': 'req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:20.449126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] The token cache is being invalidate because project ba3fb93041464e8baf9e4fcebd832b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:26:20.449419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:20.450060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-32af249b-c2b3-4fc3-a9a3-c0cb446a1e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:20.451622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1234/2461] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:26:20 2022] DELETE /identity/v3/projects/ba3fb93041464e8baf9e4fcebd832b2c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:20.461289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.461289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.461289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.475201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:20.476442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:20.533557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1228/2462] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:20.542805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.543121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.543397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.562223 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:20.563394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:20.571496 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1235/2463] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:20.575954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.585309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37135895-fc61-4e9e-be6b-b2604509c21b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.590368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.591005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.591284 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.591589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.592300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:26:20.592604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.594202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.605194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1229/2464] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:26:20.609000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.617827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8210-5eea-411a-84d6-a7f4c55330b7 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.622498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.623135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.623420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.623733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.624412 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.626352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.708049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1236/2465] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:26:20 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:20.712007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.722185 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66742c-07cb-4baa-943a-fbcb484aa204 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.775230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.776146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.777047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.777327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.778016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.780066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.853422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1230/2466] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:26:20 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:20.857535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.867520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9eb6-5b55-4c7a-8f3b-929e98df1e9a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.872385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.873046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.873352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.873644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.874346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.876002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.886908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1237/2467] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:26:20.890747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.900772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa275d-c964-43bc-9e65-eeed02fa3f9e admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.906393 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.907056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.907339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.908043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.908708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.910371 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d1f7-7a95-4e07-8dfe-d91e4826db43 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:20.923426 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1231/2468] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:26:20.924591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:20.934189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4492aa-f900-4518-aee3-bbd7c47d1ca1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:20.938943 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:20.939908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:20.940194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:20.940467 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] PATH_INFO: `/v3/projects/8777b347f65c4aa9a5725c0e3f91978f/users/abfe867213d340ada5a84499fa3bdaa8/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:20.956947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8777b347f65c4aa9a5725c0e3f91978f, user_id=abfe867213d340ada5a84499fa3bdaa8, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:20.959670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.044680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1238/2469] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:26:20 2022] PUT /identity/v3/projects/8777b347f65c4aa9a5725c0e3f91978f/users/abfe867213d340ada5a84499fa3bdaa8/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:26:21.054985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.055698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.055821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.082572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] MFA Rules not processed for user `abfe867213d340ada5a84499fa3bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:21.083814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:21.144868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1232/2470] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:26:21.149637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.215453 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e2ca-ac97-4bff-891b-7b13fc00ea6f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.220428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.221088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.221372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.221726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.222422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.225818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.352301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1239/2471] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:26:21 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:21.355594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.364949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763e62-f721-4f4f-a1db-53b120edc6d6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.422317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.422985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.423267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.423571 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.424254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.426161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.497964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1233/2472] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:26:21 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:21.499190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.509452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddef702-17b3-48c2-a9ff-12722f38395a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.514720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.515501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.515797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.516217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.516972 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.518596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.530136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1240/2473] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:26:21.534658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.545099 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1005-1679-4e9f-8805-b4e47ffdd735 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.549681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.550580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.550867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.551145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] PATH_INFO: `/v3/projects/20c0ca593b41441da17c119493c5fccb/users/9d3619fbc4e54d019d6e779ff3e819ec/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.566368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c0ca593b41441da17c119493c5fccb, user_id=9d3619fbc4e54d019d6e779ff3e819ec, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.569231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.665563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1234/2474] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:26:21 2022] PUT /identity/v3/projects/20c0ca593b41441da17c119493c5fccb/users/9d3619fbc4e54d019d6e779ff3e819ec/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:21.669922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.679949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e3c0-b534-4d00-a5cc-e7a1148ad3b5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.737231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.737895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.738174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.738441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.739169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.740838 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2faae-9f6f-4abe-b724-5229fc18175c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.751966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1241/2475] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:26:21.756081 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.766838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6614fa-ccda-4455-b55f-0236bf5c1e75 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.771656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.772576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.772857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.773133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] PATH_INFO: `/v3/projects/20c0ca593b41441da17c119493c5fccb/users/9d3619fbc4e54d019d6e779ff3e819ec/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.775112 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c0ca593b41441da17c119493c5fccb, user_id=9d3619fbc4e54d019d6e779ff3e819ec, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.778282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.789728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1235/2476] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:26:21 2022] PUT /identity/v3/projects/20c0ca593b41441da17c119493c5fccb/users/9d3619fbc4e54d019d6e779ff3e819ec/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:21.800418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.800719 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.801004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.828332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] MFA Rules not processed for user `9d3619fbc4e54d019d6e779ff3e819ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:21.829559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:21.895159 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1242/2477] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:21.906900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:21.909059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:21.964887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfaa41-8604-4ead-a3b6-a324d54a970d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:21.968477 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:21.969150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:21.969433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:21.969711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:21.978567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:21.980633 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834818ee-6f98-4084-89e3-f3b5c41f0cd3 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:21.989944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1236/2478] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:22.211860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:22.213673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:22.233390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a009-62a5-479f-8b40-b0aae735f823 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:22.237173 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:22.237821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:22.238101 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:22.238372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:22.292695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:22.294119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:22.302918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1243/2479] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:47.493447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:47.493945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:47.494348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:47.524390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] MFA Rules not processed for user `dc77bc705e44486fa93db5f88ccaa7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:47.525639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:47.578019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:47.579539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:47.583123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1237/2480] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 12 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:26:47.605902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:47.607529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:47.638773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4173-2407-4c2b-a99e-484d7c1e95c8 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:47.642930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:47.643618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:47.643909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:47.644187 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:47.646002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:47.673763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413908-2913-4aea-8468-9484d97b6a2b None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:47.678718 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35f5b8f9e834adb8d67eb2b6fb4ec62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:47.679350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:47.679655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:47.679925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:47.687943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:47.689451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:47.698286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1238/2481] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 12 08:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 08:26:47.711019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:47.712334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:47.723702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1244/2482] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:26:53.077956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:53.079701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:53.097389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd43bf-87c3-4ef2-8f67-b3a8ec2e330f service swift] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:53.106635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:53.107587 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:53.108048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:53.109218 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] PATH_INFO: `/v3/users/ad2204eb50114552898320fcdb5577d9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:53.110460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2204eb50114552898320fcdb5577d9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:53.112631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:53.325187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2204eb50114552898320fcdb5577d9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.325952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2204eb50114552898320fcdb5577d9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.333342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2204eb50114552898320fcdb5577d9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.349324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2204eb50114552898320fcdb5577d9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.413164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e85c2cb3-3501-432d-85f0-3ecd0da1562b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2204eb50114552898320fcdb5577d9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.419900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1239/2483] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:26:53 2022] DELETE /identity/v3/users/ad2204eb50114552898320fcdb5577d9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:53.727861 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:53.741629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91d10-9b56-4ffd-ae4f-3b64f3461e4a service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:53.804277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:53.805151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:53.805435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:53.805851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] PATH_INFO: `/v3/projects/c5df5bdc6238443fb11973f52caf4c09` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:53.807237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5df5bdc6238443fb11973f52caf4c09)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:53.809226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:53.921748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5df5bdc6238443fb11973f52caf4c09', 'request_id': 'req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:53.930075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5df5bdc6238443fb11973f52caf4c09', 'request_id': 'req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:54.021644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5df5bdc6238443fb11973f52caf4c09', 'request_id': 'req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:54.034015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] The token cache is being invalidate because project c5df5bdc6238443fb11973f52caf4c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:26:54.034240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:54.035822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b182d771-f4b4-454c-9dd5-2f2c4eb826d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:54.037603 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1245/2484] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:26:53 2022] DELETE /identity/v3/projects/c5df5bdc6238443fb11973f52caf4c09 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:54.042432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.042793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.043077 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.062010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:54.063227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:54.124863 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1240/2485] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:26:54.132671 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.133174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.133456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.152508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:54.153710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:54.162032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1246/2486] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:26:54.166232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.175653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5abbe-08d3-4d12-ab72-f4c3d23dc50c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.180503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.181168 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.181897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.181897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.182432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:26:54.182929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.184585 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.200560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1241/2487] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:26:54.201783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.211870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a7a8-977c-437f-a2e7-d4e0d7572698 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.217031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.218037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.218574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.218708 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.219520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.221661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.309715 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1247/2488] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:26:54 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:54.314550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.327902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1abb5-a7f8-4acd-afe3-58e866eb83a7 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.395098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.399660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.399660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.399660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.399660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.399660 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.499904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1242/2489] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:26:54 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:26:54.505189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.515638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9317a4-ce83-4a7c-b0ae-65645f4db40e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.520651 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.521325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.521610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.521887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.522624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.525423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.537448 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1248/2490] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:26:54.541644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.554829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2df9-0d01-4a1d-b3dc-871bb307546b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.561993 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.562847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.563034 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.563397 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.564241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.566107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f19f3-4ee0-4f45-a55d-f13239cd4858 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.580667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1243/2491] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:26:54.581812 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.592476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc37b2-00f9-4427-b30e-514b37afe0e9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.597777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.598661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.598945 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.599219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] PATH_INFO: `/v3/projects/00308fc4bff74dca8e4e41cc0a3a0600/users/934f298b5cb840eb90ff16a987f60345/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.615915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00308fc4bff74dca8e4e41cc0a3a0600, user_id=934f298b5cb840eb90ff16a987f60345, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.618815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.688582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1249/2492] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:26:54 2022] PUT /identity/v3/projects/00308fc4bff74dca8e4e41cc0a3a0600/users/934f298b5cb840eb90ff16a987f60345/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:54.698998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.699417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.699808 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.727089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] MFA Rules not processed for user `934f298b5cb840eb90ff16a987f60345`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:26:54.728466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:54.799222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1244/2493] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:26:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:26:54.812093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:54.814540 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:54.889325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720bcb4-5c24-42a9-a6a5-8c1eab66563b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:54.895237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:54.896002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:54.896367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:54.896710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:54.905542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:54.907269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:54.916855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1250/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:26:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:26:58.232076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:58.236084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:58.302331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049c26-e9b9-447d-a89b-3d9dd24c2133 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:58.306801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:58.307702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:58.307979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:58.308254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] PATH_INFO: `/v3/users/afe446553c7f4926b3ce94039109a24d` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:58.309432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe446553c7f4926b3ce94039109a24d)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:58.311609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:58.529620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe446553c7f4926b3ce94039109a24d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:58.530294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe446553c7f4926b3ce94039109a24d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:58.537438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe446553c7f4926b3ce94039109a24d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:58.548817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe446553c7f4926b3ce94039109a24d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:58.621461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe446553c7f4926b3ce94039109a24d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:58.628227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1245/2495] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:26:58 2022] DELETE /identity/v3/users/afe446553c7f4926b3ce94039109a24d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:58.889365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:58.904736 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff13a4-50e5-4694-b293-125592eaf796 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:58.973342 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:58.974120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:58.974402 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:58.974672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] PATH_INFO: `/v3/projects/363e74209dea4f4cb1a53e9d32f43f7e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:58.975915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=363e74209dea4f4cb1a53e9d32f43f7e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:58.977923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:59.087150 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363e74209dea4f4cb1a53e9d32f43f7e', 'request_id': 'req-8cc207df-9a66-474f-9182-6844c938df7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.092348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363e74209dea4f4cb1a53e9d32f43f7e', 'request_id': 'req-8cc207df-9a66-474f-9182-6844c938df7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.156657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363e74209dea4f4cb1a53e9d32f43f7e', 'request_id': 'req-8cc207df-9a66-474f-9182-6844c938df7f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.164329 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] The token cache is being invalidate because project 363e74209dea4f4cb1a53e9d32f43f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:26:59.164649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.165320 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.166854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1251/2496] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:26:58 2022] DELETE /identity/v3/projects/363e74209dea4f4cb1a53e9d32f43f7e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:59.171366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:59.172797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:59.186049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab811-3814-4227-bb20-3a3be655d46d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:59.240978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:59.241780 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:59.242064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:59.242376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] PATH_INFO: `/v3/users/4e31716f7a9c41afa356414a1bd65bda` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:59.243580 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e31716f7a9c41afa356414a1bd65bda)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:59.245485 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:59.427069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e31716f7a9c41afa356414a1bd65bda'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.427830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e31716f7a9c41afa356414a1bd65bda'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.435002 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e31716f7a9c41afa356414a1bd65bda'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.446362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e31716f7a9c41afa356414a1bd65bda'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.500882 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-85fde07c-985f-4c1a-92b3-d850b03b455e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e31716f7a9c41afa356414a1bd65bda'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.506834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1246/2497] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:26:59 2022] DELETE /identity/v3/users/4e31716f7a9c41afa356414a1bd65bda => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:26:59.740776 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:26:59.741851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:26:59.754313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc207df-9a66-474f-9182-6844c938df7f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:26:59.809363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:26:59.810220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:26:59.810500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:26:59.810780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] PATH_INFO: `/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:26:59.812221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f37e9b3f6c4b468cc0251cdb77040e)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:26:59.814139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:26:59.958240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f37e9b3f6c4b468cc0251cdb77040e', 'request_id': 'req-e3b61946-e764-44e5-b106-eb6c1e9cf520'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:26:59.963364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f37e9b3f6c4b468cc0251cdb77040e', 'request_id': 'req-e3b61946-e764-44e5-b106-eb6c1e9cf520'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:00.047509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f37e9b3f6c4b468cc0251cdb77040e', 'request_id': 'req-e3b61946-e764-44e5-b106-eb6c1e9cf520'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:00.058315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] The token cache is being invalidate because project e3f37e9b3f6c4b468cc0251cdb77040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:00.058595 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:00.059210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e3b61946-e764-44e5-b106-eb6c1e9cf520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:00.060755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1252/2498] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:26:59 2022] DELETE /identity/v3/projects/e3f37e9b3f6c4b468cc0251cdb77040e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:00.066276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.066566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.066832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.085323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:00.086560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:00.141766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1247/2499] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:00.149713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.150012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.150293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.168470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:00.169665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:00.177705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1253/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:00.182183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.192519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ccdfe-e11c-441e-bdeb-7622e705d6c0 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.197059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.209949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.213092 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1248/2501] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:00.217463 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.226584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cfbc7-0279-4ebd-b047-bcf80537161a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.231300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.232061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.232352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.232631 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.233834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.235878 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.328803 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1254/2502] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:00.332895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.342855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fb63-a80a-498b-a9c2-dced7ff7974f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.397374 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.398035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.398319 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.398594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.399283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.401226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.496042 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1249/2503] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:00 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:00.497239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.507559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13e477-8887-490e-825e-3808e4c625d4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.512692 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.513354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.513682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.513960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.515257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.516889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.527546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1255/2504] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:00.532480 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.542804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78903c74-33f3-4bb5-9d0b-49cc16657842 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.549348 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.550221 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.550529 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.550844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.551680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.553276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7073-12fa-471c-bcd1-449bc221bd06 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.564122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1250/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:00.568327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.578985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2f42-65d9-4e00-9ccd-e97c76a0fbee admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.588752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.589757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.590114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.590460 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] PATH_INFO: `/v3/projects/0f60295b03664d50a09fad14e734f40a/users/e67b9ceb63634f56a5467f71e93372bf/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.605755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f60295b03664d50a09fad14e734f40a, user_id=e67b9ceb63634f56a5467f71e93372bf, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.608505 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.670306 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1256/2506] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:00 2022] PUT /identity/v3/projects/0f60295b03664d50a09fad14e734f40a/users/e67b9ceb63634f56a5467f71e93372bf/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:00.676323 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.676621 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.676894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.695900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:00.697093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:00.754508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1251/2507] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:00.764078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:00.766324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:00.823000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e9280-70ea-4225-93c2-b38ce2801f27 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:00.826652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:00.827898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:00.828198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:00.828461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:00.837381 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:00.838745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af3cb-61db-458f-875a-e8a76be73508 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:00.848064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1257/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:06.408658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:06.411114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:06.428224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa9512-0f02-4a60-af8f-7fc95b7133ce None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:06.435549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:06.436496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:06.437203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:06.437508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] PATH_INFO: `/v3/users/934f298b5cb840eb90ff16a987f60345` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:06.439365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934f298b5cb840eb90ff16a987f60345)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:06.441409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:06.622683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934f298b5cb840eb90ff16a987f60345'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:06.623908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934f298b5cb840eb90ff16a987f60345'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:06.651121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934f298b5cb840eb90ff16a987f60345'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:06.670082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934f298b5cb840eb90ff16a987f60345'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:06.730387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e8191549-7805-49a6-8adb-470f6d7e2366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934f298b5cb840eb90ff16a987f60345'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:06.739540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1252/2509] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:06 2022] DELETE /identity/v3/users/934f298b5cb840eb90ff16a987f60345 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:06.743960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:06.744404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:06.744660 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:06.770335 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:06.771994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:06.777996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:06.777996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:06.777996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:06.807578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] MFA Rules not processed for user `e67b9ceb63634f56a5467f71e93372bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:06.809001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:06.874111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1258/2510] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:06.884275 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:06.886081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:06.936706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1253/2511] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:06.937586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:06.939058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:06.955702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e00c-d16c-4605-9e16-14832be7c63e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:06.959111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fa1a-83c3-4b95-a5b0-1031ec57a2b3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:06.962688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:06.963360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:06.963682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:06.964139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:06.964264 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:06.964804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:06.965195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:06.966198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:06.966520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:06.968564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:06.982099 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:06.984457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:06.994325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1259/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:07.091852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1254/2513] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:06 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:07.095862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.105231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a257d-fbf1-4eba-a4af-7030ef043acc service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.160139 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.160806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.161088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.161363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.162050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.164039 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.249624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1260/2514] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:07 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:07.252898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.269827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711662c5-72ac-4c07-81e6-eca9e420803d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.277769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.278892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.279369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.280052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.281075 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.283821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.302178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1255/2515] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:07.306330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.319729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c224e4-473c-47ce-bd24-20d01afa9b55 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.325799 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.327574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.332393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.332880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] PATH_INFO: `/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5/users/9a267407f62d4fbc91719b7e7832e679/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.354362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf1d1c302b84afe9b2c4c576f54c3d5, user_id=9a267407f62d4fbc91719b7e7832e679, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.356025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.437845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.439776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:07.453061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0243b8-d36a-4de8-bfc9-27cc69578619 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.464416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.464416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.464416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.464416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] PATH_INFO: `/v3/projects/00308fc4bff74dca8e4e41cc0a3a0600` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.464738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00308fc4bff74dca8e4e41cc0a3a0600)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.464738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.468956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1261/2516] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:07 2022] PUT /identity/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5/users/9a267407f62d4fbc91719b7e7832e679/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:07.472860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.535963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca221d-4880-4c59-a76f-3b5b4a3bd3a5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.540642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.541304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.541591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.541870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.542647 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.544316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.557371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1262/2517] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:07.559718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.571806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba695db-0400-43f7-a381-e7e9f07cde4c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.576749 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.577641 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.577923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.578198 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] PATH_INFO: `/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5/users/9a267407f62d4fbc91719b7e7832e679/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.580228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf1d1c302b84afe9b2c4c576f54c3d5, user_id=9a267407f62d4fbc91719b7e7832e679, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.582864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632b2e-5577-433a-89f3-45a14d5a49e0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.587548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00308fc4bff74dca8e4e41cc0a3a0600', 'request_id': 'req-1530d6b2-c153-43ad-a284-4584f50bbbe1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:07.593606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1263/2518] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:07 2022] PUT /identity/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5/users/9a267407f62d4fbc91719b7e7832e679/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:07.597175 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00308fc4bff74dca8e4e41cc0a3a0600', 'request_id': 'req-1530d6b2-c153-43ad-a284-4584f50bbbe1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:07.678388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00308fc4bff74dca8e4e41cc0a3a0600', 'request_id': 'req-1530d6b2-c153-43ad-a284-4584f50bbbe1'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:07.689904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] The token cache is being invalidate because project 00308fc4bff74dca8e4e41cc0a3a0600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:07.690203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:07.690835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1530d6b2-c153-43ad-a284-4584f50bbbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:07.692415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1256/2519] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:07 2022] DELETE /identity/v3/projects/00308fc4bff74dca8e4e41cc0a3a0600 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:07.697504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.697793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.698067 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.719433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:07.720782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:07.783829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1264/2520] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:07.792457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.793073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.793539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.813019 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:07.814212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:07.822847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1257/2521] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:07.827896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.837870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43fc6-3946-4522-a7e7-5e06398543ff None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.844365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.845051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.845328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.845598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.849279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:07.849279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.849279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.865355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1265/2522] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:07.865912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.875778 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65991cc-1178-43a1-8430-e52fa778bc18 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:07.881847 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:07.882549 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:07.882817 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:07.883138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:07.884924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:07.886881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:07.970682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1258/2523] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:07 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:07.974811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:07.985042 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bdfb9-f2a4-436a-bd99-dd3610faf52d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.046635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.047681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.048213 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.049220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.050215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.052569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.169513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1266/2524] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:07 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:08.174055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:08.190754 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9d79-3323-4b60-81cb-04fc854212b7 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.196710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.197381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.197676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.197936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.198921 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.200845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.213407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1259/2525] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:08.217695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:08.228231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101766ff-fa87-4f7e-abb0-c97106fddf36 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.233598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.234281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.234569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.234840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.235598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.237196 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c461aa-a58e-4bb0-9fa0-f164249045db admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.251584 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1267/2526] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:08.251915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:08.261518 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e87f-ea82-48c2-9c7f-5567656155e3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.266414 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.267291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.267606 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.267884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] PATH_INFO: `/v3/projects/61aef70a8bde4775853b49a8c6ea26c8/users/eabdf1e018554a0993cf8cd6f85e165e/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.301334 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aef70a8bde4775853b49a8c6ea26c8, user_id=eabdf1e018554a0993cf8cd6f85e165e, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.304067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.375465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1260/2527] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:08 2022] PUT /identity/v3/projects/61aef70a8bde4775853b49a8c6ea26c8/users/eabdf1e018554a0993cf8cd6f85e165e/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:08.386283 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.386570 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.386845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.427178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] MFA Rules not processed for user `eabdf1e018554a0993cf8cd6f85e165e`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:08.432709 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:08.507088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1268/2528] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:08.512512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:08.653734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6da6c4-d335-43a6-979e-6671a368067f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.661418 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.662678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.664550 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.664839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.668845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.670825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.789037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1261/2529] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:08 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:08.793028 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:08.812336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7015a6-5eb2-4444-9e8c-52af4def7095 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:08.879420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:08.880290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:08.880486 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:08.880773 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:08.881529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:08.884115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:08.995581 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1269/2530] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:08 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:09.000117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.016519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fb22-341f-4255-8c8d-a261e9b5a567 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.023415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.024500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.024979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.025267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.026017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.027903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.047521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1262/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:09.049279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.062284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50765a-a49f-4ec4-bb77-4d313fb00a25 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.069740 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.070823 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.071201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.071619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] PATH_INFO: `/v3/projects/abe8458aaa9c4b6daeabccb059270c96/users/3b938c5323dc40afbaad426e98475cb7/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.096266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe8458aaa9c4b6daeabccb059270c96, user_id=3b938c5323dc40afbaad426e98475cb7, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.097349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.183310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1270/2532] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:09 2022] PUT /identity/v3/projects/abe8458aaa9c4b6daeabccb059270c96/users/3b938c5323dc40afbaad426e98475cb7/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:09.185282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.198974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe066936-1819-455b-be7c-4131604c98a5 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.266100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.267784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.267784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.267784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.268658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.270453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ac2a-a07b-4ae9-99e5-6ca4665c5da5 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.284251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1263/2533] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:09.285461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.296966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f917-57f3-4efb-9b72-c38d49f6629d admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.302385 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.303520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.303689 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.303857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] PATH_INFO: `/v3/projects/abe8458aaa9c4b6daeabccb059270c96/users/3b938c5323dc40afbaad426e98475cb7/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.305802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe8458aaa9c4b6daeabccb059270c96, user_id=3b938c5323dc40afbaad426e98475cb7, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.308609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.321235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1271/2534] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:09 2022] PUT /identity/v3/projects/abe8458aaa9c4b6daeabccb059270c96/users/3b938c5323dc40afbaad426e98475cb7/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:09.332023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45197-5862-4615-8795-a83fae94733c None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.332465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45197-5862-4615-8795-a83fae94733c None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.332840 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45197-5862-4615-8795-a83fae94733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.370244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b6b45197-5862-4615-8795-a83fae94733c None None] MFA Rules not processed for user `3b938c5323dc40afbaad426e98475cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:09.372271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b6b45197-5862-4615-8795-a83fae94733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:09.446283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1264/2535] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:09.458144 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.459909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:09.522965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223da3-966d-4f8e-9b98-fa144f030de2 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.526630 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.527278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.527588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.527864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.538687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.540235 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.555604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1272/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:09.768896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b45197-5862-4615-8795-a83fae94733c None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:09.779886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b45197-5862-4615-8795-a83fae94733c None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:09.784623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:09.785712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:09.786208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:09.788258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:09.869845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:09.869845 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c462759-e0a9-4d80-8b65-4237a3e3af8f service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:09.909962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1265/2537] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:10.758549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:10.760095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:10.848258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355da08-274f-49d6-8d00-dd56e482bd49 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:10.855571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:10.856787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:10.857178 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:10.857753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] PATH_INFO: `/v3/users/abfe867213d340ada5a84499fa3bdaa8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:10.859239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfe867213d340ada5a84499fa3bdaa8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:10.862119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:11.073086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfe867213d340ada5a84499fa3bdaa8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:11.081285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfe867213d340ada5a84499fa3bdaa8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:11.099648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfe867213d340ada5a84499fa3bdaa8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:11.190973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfe867213d340ada5a84499fa3bdaa8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:11.191955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfe867213d340ada5a84499fa3bdaa8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:11.200316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1273/2538] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:10 2022] DELETE /identity/v3/users/abfe867213d340ada5a84499fa3bdaa8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:11.205505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:11.206364 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:11.206861 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:11.225695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:11.227190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:11.312329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1266/2539] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:11.322670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:11.324673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:11.399654 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd02b-d759-429a-acec-8f6d34a62a23 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:11.406721 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:11.407399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:11.407734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:11.408013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:11.419828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:11.422334 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:11.441587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1274/2540] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:12.346128 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:12.349787 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:12.367011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8122a-40c2-4959-a015-a2cf5ec6627e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:12.374971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:12.376421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:12.377134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:12.377639 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] PATH_INFO: `/v3/projects/8777b347f65c4aa9a5725c0e3f91978f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:12.379588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8777b347f65c4aa9a5725c0e3f91978f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:12.388389 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:12.527380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8777b347f65c4aa9a5725c0e3f91978f', 'request_id': 'req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:12.551999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8777b347f65c4aa9a5725c0e3f91978f', 'request_id': 'req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:12.652400 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8777b347f65c4aa9a5725c0e3f91978f', 'request_id': 'req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:12.668630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] The token cache is being invalidate because project 8777b347f65c4aa9a5725c0e3f91978f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:12.668908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:12.669588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0d542764-fb36-4c0b-83d1-0eaa8f23a8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:12.676522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1267/2541] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:12 2022] DELETE /identity/v3/projects/8777b347f65c4aa9a5725c0e3f91978f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:12.677040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:12.688160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa63f1-8b46-4a31-a4c4-24f285536d12 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:12.820586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:12.822154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:12.822498 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:12.822782 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] PATH_INFO: `/v3/users/9d3619fbc4e54d019d6e779ff3e819ec` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:12.824596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3619fbc4e54d019d6e779ff3e819ec)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:12.827262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:13.025349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3619fbc4e54d019d6e779ff3e819ec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.033077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3619fbc4e54d019d6e779ff3e819ec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.045310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3619fbc4e54d019d6e779ff3e819ec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.130858 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3619fbc4e54d019d6e779ff3e819ec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.131970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3619fbc4e54d019d6e779ff3e819ec'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.139882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1275/2542] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:12 2022] DELETE /identity/v3/users/9d3619fbc4e54d019d6e779ff3e819ec => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:13.625757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:13.626818 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:13.627059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:13.635157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:13.636561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:13.666229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] MFA Rules not processed for user `9a267407f62d4fbc91719b7e7832e679`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:13.667406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:13.718552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e470-e013-4c73-9591-788e05382c03 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:13.724195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:13.725390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:13.725820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:13.726282 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] PATH_INFO: `/v3/projects/20c0ca593b41441da17c119493c5fccb` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:13.727509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c0ca593b41441da17c119493c5fccb)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:13.729430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:13.765644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1268/2543] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:13.777038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:13.778505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:13.832635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c0ca593b41441da17c119493c5fccb', 'request_id': 'req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.840497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c0ca593b41441da17c119493c5fccb', 'request_id': 'req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.862661 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda73f98-b591-4bb3-bc32-db96f38b1804 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:13.927998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:13.928664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:13.928942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:13.929210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:13.931005 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:13.935233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c0ca593b41441da17c119493c5fccb', 'request_id': 'req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.948269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] The token cache is being invalidate because project 20c0ca593b41441da17c119493c5fccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:13.948573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.949323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1e58fc4b-103d-4ad3-b7e5-c7c03d5f61c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:13.951318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1276/2544] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:13 2022] DELETE /identity/v3/projects/20c0ca593b41441da17c119493c5fccb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:13.956143 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:13.956430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:13.956711 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:13.976971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:13.978271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:13.998792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.000407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3d809-173e-451a-b1a7-3f4c55242566 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.011684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1269/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:14.050985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1277/2546] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:14.058776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.059135 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.059424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.079290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:14.080873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:14.091710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1270/2547] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:14.100063 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.111347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb69c1-0804-4578-9530-d27787a84c9d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.116356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.117084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.118666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.118666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.118937 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:14.119378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.121230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.134210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1278/2548] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:14.140690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.150402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11aac-90a6-4cb9-90ff-45c5f3ed313e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.155577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.160327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.160327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.160327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.160327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.160327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.250153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1271/2549] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:14.252215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.262185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a8b9-03d7-487b-ba14-cb71c09c7b32 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.326659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.327427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.327807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.328155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.328918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.330911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.394406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1279/2550] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/users => generated 304 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:14.398447 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.410180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001441f-2573-4b38-8d11-f7370cce1100 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.415172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.415877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.416164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.416443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.417173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.418779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.429731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1272/2551] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:14.433965 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.444000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f5c3-167d-4290-8be5-b147f67af95c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.448843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.449571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.449944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.450284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.451074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.453288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e95a-4902-4521-ae1d-dcc034d1f78e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.463729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1280/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:14.468072 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.477969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09bdf-1621-4043-89e6-fb3f391fcb04 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.482965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.488685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.488685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.488685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] PATH_INFO: `/v3/projects/4d3c705a947d44e38c574eb1cd8e5b36/users/4061f615f0014e23bee4e309d8bc0abb/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.499919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3c705a947d44e38c574eb1cd8e5b36, user_id=4061f615f0014e23bee4e309d8bc0abb, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.502795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.574143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1273/2553] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:14 2022] PUT /identity/v3/projects/4d3c705a947d44e38c574eb1cd8e5b36/users/4061f615f0014e23bee4e309d8bc0abb/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:14.584938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.585362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.585679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.612815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] MFA Rules not processed for user `4061f615f0014e23bee4e309d8bc0abb`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:14.615548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:14.682114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1281/2554] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:14.686848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.747976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594884-4c88-41c7-bb9a-ad55f84c7be3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.753030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.753687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.753966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.754238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.754930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.756988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:14.863543 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1274/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/projects => generated 409 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:14.864765 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:14.875887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61d84e-3afd-4e69-a886-896ad47372dd None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:14.938396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:14.938992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:14.939273 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:14.939578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:14.940267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:14.942175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.059508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1282/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:14 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:15.061423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.072996 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b315e-31d7-4c7a-9abc-b3b12e7fe678 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.078757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.079974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.080117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.080504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.081211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.083138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.095148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1275/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:15.099383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.109375 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4385-a50e-49cb-8357-6e58bddf1de6 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.114401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.115309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.115627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.115910 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] PATH_INFO: `/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b/users/8e1bd1ed630b40e8ae24440a6ba68268/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.131126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e86d5bd410f4b8cac5698b9c8f8db1b, user_id=8e1bd1ed630b40e8ae24440a6ba68268, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.133909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.216010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1283/2558] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:15 2022] PUT /identity/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b/users/8e1bd1ed630b40e8ae24440a6ba68268/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:15.220259 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.230519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289295d-6d42-438d-b229-4f660183644d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.293552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.294220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.294503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.294781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.296265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.297924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9def5d2-28df-4eff-9c57-3c78c2f25430 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.307648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1276/2559] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:15.312513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.323234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ea107-b81f-409e-8b15-56500290512e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.329181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.331116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.331116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.331116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] PATH_INFO: `/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b/users/8e1bd1ed630b40e8ae24440a6ba68268/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.332743 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e86d5bd410f4b8cac5698b9c8f8db1b, user_id=8e1bd1ed630b40e8ae24440a6ba68268, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.335400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.346868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1284/2560] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:15 2022] PUT /identity/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b/users/8e1bd1ed630b40e8ae24440a6ba68268/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:15.358325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.358612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.358888 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.385321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] MFA Rules not processed for user `8e1bd1ed630b40e8ae24440a6ba68268`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:15.386599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:15.455036 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1277/2561] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:15.466094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.468003 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:15.527225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9fbd-bcdf-4958-b753-5d17f051f9ee admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.530946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.531661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.531944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.532219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.541209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.542637 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4657e5c-7ca7-44d9-832a-4f6a1fab3269 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:15.552466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1285/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:15.895944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:15.909132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62372c3-d186-4c41-af57-543517682fb1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:15.914532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:15.915189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:15.915489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:15.917387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:15.990060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:15.991632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:16.002760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1278/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:17.154284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1ac9-34fd-4fb0-9560-93b1ebfb45ae None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:17.154946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1ac9-34fd-4fb0-9560-93b1ebfb45ae None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:17.155148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1ac9-34fd-4fb0-9560-93b1ebfb45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:17.174446 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-042b1ac9-34fd-4fb0-9560-93b1ebfb45ae None None] MFA Rules not processed for user `e67b9ceb63634f56a5467f71e93372bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:17.176734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-042b1ac9-34fd-4fb0-9560-93b1ebfb45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:17.237285 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1286/2564] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:24.875093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:24.878213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:24.943760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96f75b-b09f-404f-a184-d78c1b7787ee service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:24.948431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:24.949332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:24.949614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:24.949922 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] PATH_INFO: `/v3/users/eabdf1e018554a0993cf8cd6f85e165e` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:24.951134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabdf1e018554a0993cf8cd6f85e165e)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:24.953085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:25.150551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabdf1e018554a0993cf8cd6f85e165e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:25.151724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabdf1e018554a0993cf8cd6f85e165e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:25.158177 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabdf1e018554a0993cf8cd6f85e165e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:25.169914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabdf1e018554a0993cf8cd6f85e165e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:25.241385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabdf1e018554a0993cf8cd6f85e165e'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:25.248144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1279/2565] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:24 2022] DELETE /identity/v3/users/eabdf1e018554a0993cf8cd6f85e165e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:25.253165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:25.253646 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:25.253755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:25.273012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:25.274221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:25.332411 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1287/2566] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:25.342332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:25.343738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:25.403420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9431-fd08-4218-bf00-55c7b6b0476a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:25.407370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:25.408059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:25.408608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:25.408889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:25.419858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:25.422759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:25.438488 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1280/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:25.843064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:25.845089 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:25.858870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c61f86-bb6b-43a9-9bbb-3db1173c0126 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:25.864292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:25.865146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:25.865425 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:25.865698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] PATH_INFO: `/v3/projects/61aef70a8bde4775853b49a8c6ea26c8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:25.868834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aef70a8bde4775853b49a8c6ea26c8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:25.874234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:25.999187 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:26.002874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.016463 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257753-947e-4865-9f47-741908507de1 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:26.021214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:26.022098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:26.022379 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:26.022648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] PATH_INFO: `/v3/users/4061f615f0014e23bee4e309d8bc0abb` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:26.023879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4061f615f0014e23bee4e309d8bc0abb)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:26.025903 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:26.033297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aef70a8bde4775853b49a8c6ea26c8', 'request_id': 'req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.041884 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aef70a8bde4775853b49a8c6ea26c8', 'request_id': 'req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.115619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aef70a8bde4775853b49a8c6ea26c8', 'request_id': 'req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.127336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] The token cache is being invalidate because project 61aef70a8bde4775853b49a8c6ea26c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:26.127658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.128310 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.129894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1288/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:25 2022] DELETE /identity/v3/projects/61aef70a8bde4775853b49a8c6ea26c8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:26.133834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:26.135183 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.200662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e380b9-3265-4d8e-88f5-fc94ec9dc605 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:26.205844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:26.206701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:26.206981 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:26.207253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] PATH_INFO: `/v3/users/3b938c5323dc40afbaad426e98475cb7` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:26.208472 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b938c5323dc40afbaad426e98475cb7)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:26.210378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:26.248982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4061f615f0014e23bee4e309d8bc0abb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.249664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4061f615f0014e23bee4e309d8bc0abb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.257479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4061f615f0014e23bee4e309d8bc0abb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.269928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4061f615f0014e23bee4e309d8bc0abb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.345118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1f6723e0-c5be-488b-86cd-62d13cf12a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4061f615f0014e23bee4e309d8bc0abb'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.351511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1281/2569] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:25 2022] DELETE /identity/v3/users/4061f615f0014e23bee4e309d8bc0abb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:26.355756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:26.356045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:26.356339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:26.373439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:26.380770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.406206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b938c5323dc40afbaad426e98475cb7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.413758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b938c5323dc40afbaad426e98475cb7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.426398 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b938c5323dc40afbaad426e98475cb7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.434698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1282/2570] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:26.444866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:26.446229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.483629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b938c5323dc40afbaad426e98475cb7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.484349 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b938c5323dc40afbaad426e98475cb7'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:26.492499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1289/2571] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:26 2022] DELETE /identity/v3/users/3b938c5323dc40afbaad426e98475cb7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:26.502865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a892d59-69d0-4828-8856-a7aa5e482e41 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:26.553489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:26.554365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:26.554735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:26.555013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:26.556931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.620898 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:26.622333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:26.632388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1283/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:26.922912 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:26.929918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:26.937312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf662c-b9df-47b9-8850-07cbc8eade38 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:26.948908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:26.949793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:26.950218 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:26.950494 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] PATH_INFO: `/v3/projects/abe8458aaa9c4b6daeabccb059270c96` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:26.951763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe8458aaa9c4b6daeabccb059270c96)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:26.953833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.061204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.072536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.075705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0d6a-d6a8-4ce4-9545-23a6ea2a300a service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.081083 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.082017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.082421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.082781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] PATH_INFO: `/v3/projects/4d3c705a947d44e38c574eb1cd8e5b36` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.084256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3c705a947d44e38c574eb1cd8e5b36)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.086258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.097492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe8458aaa9c4b6daeabccb059270c96', 'request_id': 'req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.103125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe8458aaa9c4b6daeabccb059270c96', 'request_id': 'req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.184634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe8458aaa9c4b6daeabccb059270c96', 'request_id': 'req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.196956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] The token cache is being invalidate because project abe8458aaa9c4b6daeabccb059270c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:27.197244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.197889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-0cb1ce7e-60ea-43ba-823e-c91ce5e01d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.199456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1290/2573] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:26 2022] DELETE /identity/v3/projects/abe8458aaa9c4b6daeabccb059270c96 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:27.204103 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465726c-245f-4f39-a035-87752a4a2393 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.204389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465726c-245f-4f39-a035-87752a4a2393 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.204664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465726c-245f-4f39-a035-87752a4a2393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.222925 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6465726c-245f-4f39-a035-87752a4a2393 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:27.224176 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6465726c-245f-4f39-a035-87752a4a2393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.237576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3c705a947d44e38c574eb1cd8e5b36', 'request_id': 'req-4147913e-a6ae-43fe-a7b4-5f78fed11c15'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.243114 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3c705a947d44e38c574eb1cd8e5b36', 'request_id': 'req-4147913e-a6ae-43fe-a7b4-5f78fed11c15'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.283668 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1291/2574] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:27.291368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.291777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.291973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.310487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:27.312915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.319681 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1292/2575] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:27.323750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.332635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55a5a-9a7e-4dcc-b968-92915a4faace None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.334000 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3c705a947d44e38c574eb1cd8e5b36', 'request_id': 'req-4147913e-a6ae-43fe-a7b4-5f78fed11c15'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.338561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.339304 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.339687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.340030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.340840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:27.341219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.342818 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.347824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] The token cache is being invalidate because project 4d3c705a947d44e38c574eb1cd8e5b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:27.348123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.348789 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.350577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1284/2576] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:27 2022] DELETE /identity/v3/projects/4d3c705a947d44e38c574eb1cd8e5b36 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:27.356896 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1293/2577] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:27:27.357655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.359103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.361161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.362822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.372751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147913e-a6ae-43fe-a7b4-5f78fed11c15 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.375157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1953f2a-e85e-4d45-9166-83e81918bf8b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.379729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.380349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.380485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.380667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.380941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.381226 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.381511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.381626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.381788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] PATH_INFO: `/v3/users/8e1bd1ed630b40e8ae24440a6ba68268` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.382998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1bd1ed630b40e8ae24440a6ba68268)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.384194 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.384964 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.445638 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1294/2578] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/projects => generated 355 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:27.449728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.510437 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10521ce-2766-4bcb-bb47-e3e55c6a4de5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.515226 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.515976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.516260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.516538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.517231 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.519165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.526143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1bd1ed630b40e8ae24440a6ba68268'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.526874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1bd1ed630b40e8ae24440a6ba68268'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.534425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1bd1ed630b40e8ae24440a6ba68268'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.549201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1bd1ed630b40e8ae24440a6ba68268'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.596531 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1295/2579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/users => generated 278 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:27.600548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.602163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.614316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb52a10-c107-4684-be27-7aaad8e68b35 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.618996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.619720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.620011 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.620291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.621024 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.622611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.634311 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1296/2580] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:27.636478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.646614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b673-9f33-453c-a749-a57008819333 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.651234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.651963 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.652250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.652528 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.653069 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1bd1ed630b40e8ae24440a6ba68268'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:27.653242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.654824 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825de9a-85d5-463c-826d-6a482387cd23 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.660257 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1285/2581] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:27 2022] DELETE /identity/v3/users/8e1bd1ed630b40e8ae24440a6ba68268 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:27.666323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1297/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:27.670955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:27.737630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967e98d-0fad-415f-a35f-77581b7c6a44 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:27.742816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:27.743756 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.744038 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.744311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] PATH_INFO: `/v3/projects/1b2cfd9532a34286b4033a59a01a464a/users/4073b37c63d043498e1f84929184b9e9/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.759051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2cfd9532a34286b4033a59a01a464a, user_id=4073b37c63d043498e1f84929184b9e9, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:27.761737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:27.850955 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1286/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:27 2022] PUT /identity/v3/projects/1b2cfd9532a34286b4033a59a01a464a/users/4073b37c63d043498e1f84929184b9e9/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:27.862359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:27.862652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:27.862934 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:27.890549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] MFA Rules not processed for user `4073b37c63d043498e1f84929184b9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:27.892524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:27.957175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1298/2584] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:27.961834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.022119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4e67f-5608-4833-bef8-b9d79863f3bb admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.027085 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.027795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.032213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.032213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.032213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.032213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.051155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.052667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.072839 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c14d23-1e90-406b-ab42-d8a9415a75b1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.075299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.076211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.076497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.076777 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] PATH_INFO: `/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.077989 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e86d5bd410f4b8cac5698b9c8f8db1b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.080625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.128875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1287/2585] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:27 2022] POST /identity/v3/projects => generated 355 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:28.132761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.193493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0486-4793-4b88-b267-bd333c21cefe admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.204653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e86d5bd410f4b8cac5698b9c8f8db1b', 'request_id': 'req-cd292294-c2ce-4938-8318-05b9ca47b142'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:28.210098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e86d5bd410f4b8cac5698b9c8f8db1b', 'request_id': 'req-cd292294-c2ce-4938-8318-05b9ca47b142'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:28.251208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.251924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.252207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.252479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.253166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.255062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.281384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e86d5bd410f4b8cac5698b9c8f8db1b', 'request_id': 'req-cd292294-c2ce-4938-8318-05b9ca47b142'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:28.293111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] The token cache is being invalidate because project 9e86d5bd410f4b8cac5698b9c8f8db1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:28.293394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:28.294095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cd292294-c2ce-4938-8318-05b9ca47b142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:28.295902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1299/2586] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:28 2022] DELETE /identity/v3/projects/9e86d5bd410f4b8cac5698b9c8f8db1b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:28.301056 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c081c-629b-404c-9aed-8c2271953fb0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.301340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c081c-629b-404c-9aed-8c2271953fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.301613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c081c-629b-404c-9aed-8c2271953fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.320323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dd3c081c-629b-404c-9aed-8c2271953fb0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:28.321517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dd3c081c-629b-404c-9aed-8c2271953fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.327362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1288/2587] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:28.331388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.332855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1300/2588] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:28.333428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.340667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.340952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.341230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.346895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe6fb-5b81-493d-9a5e-a14c13e3fa73 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.351553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.352217 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.352501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.352779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.353531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.355125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.360789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:28.361962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.369763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1289/2589] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:28.371687 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1301/2590] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:28.372324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.374415 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.384037 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c612be-98eb-4017-b8e0-fde55806fda0 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.384330 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16e07-1573-40d2-8cdb-0d2e103caf13 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.388758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.389416 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.389539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.389747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.390027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.390423 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.390708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.390830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:28.390981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] PATH_INFO: `/v3/projects/def0ca869421460c9a20e33221b0fa6f/users/afabc2ca4b1846c2a9e89e92401415fd/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.391090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.392675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.404985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1302/2591] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:27:28.407232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def0ca869421460c9a20e33221b0fa6f, user_id=afabc2ca4b1846c2a9e89e92401415fd, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.409499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.410632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.419991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0936-c050-4077-824b-3d111a28ac51 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.425598 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.426253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.426539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.426815 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.427527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.429426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.458589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1290/2592] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:28 2022] PUT /identity/v3/projects/def0ca869421460c9a20e33221b0fa6f/users/afabc2ca4b1846c2a9e89e92401415fd/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:28.462475 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.522686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947dad5-3414-4138-8301-945ff4ffc307 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.527508 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.528176 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.528462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.528742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.529462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.531065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.541206 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1291/2593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:28.545202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.554345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1303/2594] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:28.556014 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81db8-3dc4-4aec-b59c-4bc977cc4751 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.558471 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.611868 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.612768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.613052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.613386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] PATH_INFO: `/v3/projects/def0ca869421460c9a20e33221b0fa6f/users/afabc2ca4b1846c2a9e89e92401415fd/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.615670 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=def0ca869421460c9a20e33221b0fa6f, user_id=afabc2ca4b1846c2a9e89e92401415fd, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.618354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30b48-fb1c-41f1-b201-9207495dd56e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.621482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98940-5b66-4f58-82c1-6cc3971eb9f7 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.626875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.627592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.627880 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.628154 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.628833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.629178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1292/2595] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:28 2022] PUT /identity/v3/projects/def0ca869421460c9a20e33221b0fa6f/users/afabc2ca4b1846c2a9e89e92401415fd/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:28.630853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.639201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.639519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.639803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.666688 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] MFA Rules not processed for user `afabc2ca4b1846c2a9e89e92401415fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:28.667934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.735458 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1293/2596] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:28.743499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1304/2597] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:28 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:28.746103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.746388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.748141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:28.805533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ae8e-8cca-4f42-bbe5-c0cbac620987 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.806030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eee73-71b3-4402-a771-2e56c3c3ef0f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.810862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.811677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.812089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.812381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.813103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.814731 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.827803 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1294/2598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:28.829157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.838528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2a0a-588b-4153-89fb-43efa886e262 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.843108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.843883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.844772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.845138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.845896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.847810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.855328 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.856031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.856313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.856586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.858380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1295/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:28.862935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:28.866791 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.868276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533767b0-743a-4494-aaca-e2a0a5f56e1d service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:28.872279 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2aed-87ca-4a5c-89ff-5fa40858232f admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:28.876852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:28.877569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1305/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:28 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:28.877760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:28.878044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:28.878316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] PATH_INFO: `/v3/projects/e570dbde41d34a3ca4ea039598afc1e1/users/0a5835856403473484816e7d28e43550/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:28.893950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e570dbde41d34a3ca4ea039598afc1e1, user_id=0a5835856403473484816e7d28e43550, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:28.896390 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.030165 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1296/2601] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:28 2022] PUT /identity/v3/projects/e570dbde41d34a3ca4ea039598afc1e1/users/0a5835856403473484816e7d28e43550/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:29.039073 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.039365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.039693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.066609 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] MFA Rules not processed for user `0a5835856403473484816e7d28e43550`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:29.067889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:29.119050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.133560 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1306/2602] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:29.138202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.174853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c6bb-452f-42f7-8997-2f95559e204b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.178784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.179437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.179752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.180032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.181896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:29.201940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171145c-17ef-457c-a99f-121b6f0380ed None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.207044 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.207741 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.208026 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.208302 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.208994 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.210899 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.239486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.240949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.250017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1297/2603] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:29.291256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1307/2604] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:29 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:29.295562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.305918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1e543-9c78-4530-a7b6-c5b8b9a6f2b9 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.361771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.362451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.362737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.363013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.363757 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.365706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.459737 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1298/2605] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:29 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:29.463779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.473785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635814-003e-47fc-a1cc-815cb13f612e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.478537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.479190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.479490 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.479855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.480562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.485728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.493132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1308/2606] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:29.497729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.509031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fda5e-1d24-49c2-a3eb-716303e5ed58 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.514874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.515801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.516681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.516952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] PATH_INFO: `/v3/projects/9628b59ed94041d9afdff4cca178376d/users/b7e5a556ba024dca93557dc45f440c5c/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.531911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9628b59ed94041d9afdff4cca178376d, user_id=b7e5a556ba024dca93557dc45f440c5c, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.534931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.620686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1299/2607] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:29 2022] PUT /identity/v3/projects/9628b59ed94041d9afdff4cca178376d/users/b7e5a556ba024dca93557dc45f440c5c/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:29.626534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.638735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28251a9-aa12-422f-9a6a-7e577fa49236 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.703124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.704333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.704615 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.704891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.705800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.707430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d95a7b-bf3e-4a0d-b8e0-8db39fb42d5c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.718372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1309/2608] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:29.722349 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.732694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf43f3-17f9-4e8d-8e5f-3f8ad92b0a7c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.737567 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.738422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.738707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.738983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] PATH_INFO: `/v3/projects/9628b59ed94041d9afdff4cca178376d/users/b7e5a556ba024dca93557dc45f440c5c/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.741062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9628b59ed94041d9afdff4cca178376d, user_id=b7e5a556ba024dca93557dc45f440c5c, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.743748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.756070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1300/2609] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:29 2022] PUT /identity/v3/projects/9628b59ed94041d9afdff4cca178376d/users/b7e5a556ba024dca93557dc45f440c5c/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:29.766854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.767148 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.767430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.795262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] MFA Rules not processed for user `b7e5a556ba024dca93557dc45f440c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:29.796537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:29.862723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1310/2610] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:29.873267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:29.931923 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b7c43-7a58-4a3a-88c1-2e9fe23797b7 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:29.935578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:29.936210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:29.936488 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:29.936760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:29.946635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:29.948097 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e61a-35d0-472f-9ea7-779208034acf service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:29.958702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1301/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:30.457434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:30.520202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c65de-35da-460d-ac45-2be5a5cfa4dc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:30.524793 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:30.525655 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:30.525932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:30.526206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] PATH_INFO: `/v3/users/0a5835856403473484816e7d28e43550` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:30.527927 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5835856403473484816e7d28e43550)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:30.529984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:30.662331 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5835856403473484816e7d28e43550'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:30.676258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5835856403473484816e7d28e43550'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:30.682423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5835856403473484816e7d28e43550'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:30.786712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5835856403473484816e7d28e43550'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:30.787433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5835856403473484816e7d28e43550'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:30.793950 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1311/2612] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:30 2022] DELETE /identity/v3/users/0a5835856403473484816e7d28e43550 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:30.798558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:30.799104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:30.799104 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:30.817058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:30.818346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:30.878369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1302/2613] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:30.888464 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:30.889969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:30.949569 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7e16-7a41-4b4c-ae96-0917c0de62db admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:30.954484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:30.955146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:30.955434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:30.955746 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:30.965941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:30.975941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:30.978290 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1312/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:31.422558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:31.424021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:31.435936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ca455-277c-4460-a977-ce50163063b9 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:31.441401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:31.442267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:31.442553 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:31.442832 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] PATH_INFO: `/v3/projects/e570dbde41d34a3ca4ea039598afc1e1` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:31.444056 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e570dbde41d34a3ca4ea039598afc1e1)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:31.445960 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:31.553806 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e570dbde41d34a3ca4ea039598afc1e1', 'request_id': 'req-03c65a81-c3f2-41ff-9fa8-2179840c000a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.559107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e570dbde41d34a3ca4ea039598afc1e1', 'request_id': 'req-03c65a81-c3f2-41ff-9fa8-2179840c000a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.649380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e570dbde41d34a3ca4ea039598afc1e1', 'request_id': 'req-03c65a81-c3f2-41ff-9fa8-2179840c000a'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.662581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] The token cache is being invalidate because project e570dbde41d34a3ca4ea039598afc1e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:31.662869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.663541 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.665132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1303/2615] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:31 2022] DELETE /identity/v3/projects/e570dbde41d34a3ca4ea039598afc1e1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:31.669114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:31.679372 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28f61-560a-4a78-8b16-84d08fcea043 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:31.738031 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:31.738905 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:31.739215 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:31.739522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] PATH_INFO: `/v3/users/b7e5a556ba024dca93557dc45f440c5c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:31.740701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e5a556ba024dca93557dc45f440c5c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:31.742604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:31.943293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e5a556ba024dca93557dc45f440c5c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.949868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e5a556ba024dca93557dc45f440c5c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:31.961509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e5a556ba024dca93557dc45f440c5c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.037843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e5a556ba024dca93557dc45f440c5c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.038447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-04253c93-7837-40a2-88f8-b5e7b86ddcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e5a556ba024dca93557dc45f440c5c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.044996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1313/2616] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:31 2022] DELETE /identity/v3/users/b7e5a556ba024dca93557dc45f440c5c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:32.467698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:32.470058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:32.482170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65a81-c3f2-41ff-9fa8-2179840c000a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:32.542866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:32.543747 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:32.544027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:32.544295 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] PATH_INFO: `/v3/projects/9628b59ed94041d9afdff4cca178376d` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:32.545522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9628b59ed94041d9afdff4cca178376d)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:32.547431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:32.679120 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9628b59ed94041d9afdff4cca178376d', 'request_id': 'req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.685535 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9628b59ed94041d9afdff4cca178376d', 'request_id': 'req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.769565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9628b59ed94041d9afdff4cca178376d', 'request_id': 'req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.781558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] The token cache is being invalidate because project 9628b59ed94041d9afdff4cca178376d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:32.781850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.782545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ab1f6e97-d13d-4ebd-b5cc-55e6b295db12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:32.784385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1304/2617] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:32 2022] DELETE /identity/v3/projects/9628b59ed94041d9afdff4cca178376d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:32.795007 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:32.795511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:32.795613 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:32.816544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:32.817735 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:32.874807 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1314/2618] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:32.883341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:32.883677 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:32.883963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:32.902031 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:32.903238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:32.911603 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1305/2619] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:32.915926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:32.926083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68dd8c-09f5-4481-81e7-6da35ca1a143 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:32.930576 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:32.931220 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:32.931537 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:32.931811 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:32.932525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:32.932828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:32.934580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:32.946512 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1315/2620] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:32.950746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:32.959834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c526-f116-4d5f-bb96-4772970f3914 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:32.964539 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:32.965180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:32.968511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:32.968511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:32.968511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:32.968511 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.056271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1306/2621] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:32 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:33.060561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:33.071351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45453-8e5f-450d-add2-b41362f37e58 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:33.124984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:33.126367 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.126652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.126931 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.127639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:33.129558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.187408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1316/2622] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:33 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:33.191084 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:33.201722 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f085-05eb-4ba2-8bc0-11ff5ef899e1 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:33.206320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:33.206966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.207244 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.207540 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.208256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:33.209887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.221352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1307/2623] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:33.225219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:33.235788 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1d40-9562-43bf-9b93-1ecd4be5964b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:33.240515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:33.241166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.241481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.241761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.242482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:33.244124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf20f-1045-48c5-968e-188fa4ffaaae admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.254519 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1317/2624] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:33.258481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:33.268683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab702b-964f-48df-8c0d-7a7969775363 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:33.273291 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:33.274157 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.274438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.274711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] PATH_INFO: `/v3/projects/893db4fe55a04d42a6169ae62ff21bbc/users/af939fb3139647fa873a2b9fbefd2566/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.289792 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=893db4fe55a04d42a6169ae62ff21bbc, user_id=af939fb3139647fa873a2b9fbefd2566, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:33.292472 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.377982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1308/2625] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:33 2022] PUT /identity/v3/projects/893db4fe55a04d42a6169ae62ff21bbc/users/af939fb3139647fa873a2b9fbefd2566/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:27:33.389106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.389397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.389674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.415662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] MFA Rules not processed for user `af939fb3139647fa873a2b9fbefd2566`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:33.416855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:33.480284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1318/2626] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:33.492311 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:33.493986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:33.551759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30551-4bcc-4888-8d2e-8e48741b9a8d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:33.555707 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cff946b0e734b1ab57587bab203d78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:33.556232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:33.556512 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:33.556785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:33.565182 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:33.566805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:33.575916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1309/2627] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:37.119517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:37.121244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:37.182930 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185cbaf-95e7-4191-bd6a-16037cfa01b3 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:37.186648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:37.187291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:37.188132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:37.188414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:37.190589 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:37.200110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:37.201664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:37.210201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1319/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:39.225044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:39.226601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:39.296296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaafbb-d79c-4c71-bcc5-461836a2ccec service glance] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:39.301997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:39.302640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:39.302925 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:39.303204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:39.305041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:39.316381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:39.318017 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a6d6-7ffa-4086-94ec-fd28b1eff285 service placement] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:39.328111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1310/2629] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:47.497001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:47.498516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:47.567070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ac94-1bdd-4537-8f30-f549b3deb2db service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:47.571677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:47.572555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:47.572851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:47.573130 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] PATH_INFO: `/v3/users/4073b37c63d043498e1f84929184b9e9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:47.574344 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4073b37c63d043498e1f84929184b9e9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:47.576295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:47.728303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4073b37c63d043498e1f84929184b9e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:47.736097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4073b37c63d043498e1f84929184b9e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:47.748728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4073b37c63d043498e1f84929184b9e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:47.818352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4073b37c63d043498e1f84929184b9e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:47.818964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4073b37c63d043498e1f84929184b9e9'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:47.825620 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1320/2630] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:47 2022] DELETE /identity/v3/users/4073b37c63d043498e1f84929184b9e9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:47.830730 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:47.831258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:47.831258 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:47.849380 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:47.850574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:47.910086 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1311/2631] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:47.919885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:47.921307 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:47.976987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64de6-e4b9-4d13-b0b7-5c7c58518d3b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:47.980874 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:47.981459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:47.981745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:47.982064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:47.991013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:47.992481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:48.001909 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1321/2632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:48.462992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:48.464439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:48.479051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6834ae-79b0-4fae-8a74-c7d22aee9bb3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:48.484589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:48.485513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:48.485795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:48.486236 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] PATH_INFO: `/v3/projects/1b2cfd9532a34286b4033a59a01a464a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:48.487521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2cfd9532a34286b4033a59a01a464a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:48.489391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:48.596383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2cfd9532a34286b4033a59a01a464a', 'request_id': 'req-a16f5f76-8486-4535-b046-6beb24ab15ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.601762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2cfd9532a34286b4033a59a01a464a', 'request_id': 'req-a16f5f76-8486-4535-b046-6beb24ab15ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.660173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2cfd9532a34286b4033a59a01a464a', 'request_id': 'req-a16f5f76-8486-4535-b046-6beb24ab15ba'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.670943 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] The token cache is being invalidate because project 1b2cfd9532a34286b4033a59a01a464a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:48.671229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.671878 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.674125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1312/2633] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:48 2022] DELETE /identity/v3/projects/1b2cfd9532a34286b4033a59a01a464a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:48.677866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:48.687407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee065e9-4173-440b-aea3-aadd5611449f service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:48.740976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:48.741769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:48.742050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:48.742325 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] PATH_INFO: `/v3/users/afabc2ca4b1846c2a9e89e92401415fd` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:48.743585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afabc2ca4b1846c2a9e89e92401415fd)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:48.745529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:48.895952 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afabc2ca4b1846c2a9e89e92401415fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.902738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afabc2ca4b1846c2a9e89e92401415fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.914718 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afabc2ca4b1846c2a9e89e92401415fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.978106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afabc2ca4b1846c2a9e89e92401415fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.978723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-265a8d0f-0627-4071-b43b-96d831559106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afabc2ca4b1846c2a9e89e92401415fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:48.985844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1322/2634] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:48 2022] DELETE /identity/v3/users/afabc2ca4b1846c2a9e89e92401415fd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:49.427369 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:49.429016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:49.447708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f5f76-8486-4535-b046-6beb24ab15ba admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:49.509065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:49.509841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:49.510124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:49.510399 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] PATH_INFO: `/v3/projects/def0ca869421460c9a20e33221b0fa6f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:49.511605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def0ca869421460c9a20e33221b0fa6f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:49.513534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:49.606324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def0ca869421460c9a20e33221b0fa6f', 'request_id': 'req-095a3c01-0fcf-4d80-931a-ae315f76fec7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:49.611724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def0ca869421460c9a20e33221b0fa6f', 'request_id': 'req-095a3c01-0fcf-4d80-931a-ae315f76fec7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:49.686415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def0ca869421460c9a20e33221b0fa6f', 'request_id': 'req-095a3c01-0fcf-4d80-931a-ae315f76fec7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:49.698401 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] The token cache is being invalidate because project def0ca869421460c9a20e33221b0fa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:49.698689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:49.699327 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-095a3c01-0fcf-4d80-931a-ae315f76fec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:49.700885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1313/2635] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:49 2022] DELETE /identity/v3/projects/def0ca869421460c9a20e33221b0fa6f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:49.706566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:49.707059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:49.707155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:49.725021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:49.726230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:49.787785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1323/2636] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:49.796578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:49.796869 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:49.797164 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:49.815269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:49.816492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:49.824261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1314/2637] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:49.828336 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:49.838428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8a78-bd5f-4dee-b4d6-1f662db060c1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:49.842977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:49.843750 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:49.844555 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:49.844842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:49.845564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:49.845872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:49.847456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:49.858443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1324/2638] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:49.863055 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:49.871956 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7db1-1a79-4d59-8c60-2de38d4d504d None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:49.876531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:49.877163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:49.877443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:49.877716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:49.878396 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:49.880336 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:49.991061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1315/2639] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:49 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:49.995222 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.004809 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162b3d-f1a9-476e-9964-0c39a5c83f3e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.058988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.059607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.059889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.060165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.060843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.062748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.234060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1325/2640] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:49 2022] POST /identity/v3/users => generated 280 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:50.236076 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.247132 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783416c-da1a-4574-8ddb-6f566bc5cbbd admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.251944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.252612 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.252875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.253146 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.253987 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.255649 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.267339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1316/2641] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:50.271544 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.283059 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7322890-d2e6-4d3b-b791-33e5011c22cb admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.288327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.289014 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.289351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.289688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.290552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.292242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7a302-a34f-4e9f-b29f-66d88e70b532 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.305451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1326/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:27:50.306595 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.324054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc25b7-8096-4084-a5b8-d73d5fb76aa6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.324054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.324054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.324054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.324474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] PATH_INFO: `/v3/projects/16a2cf813b5a4754807a9b1733cfd872/users/a3826260d1944cfc9e99a218bb82d073/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.337515 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a2cf813b5a4754807a9b1733cfd872, user_id=a3826260d1944cfc9e99a218bb82d073, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.340193 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.509824 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1317/2643] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:50 2022] PUT /identity/v3/projects/16a2cf813b5a4754807a9b1733cfd872/users/a3826260d1944cfc9e99a218bb82d073/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:50.520700 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.520988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.521269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.547395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] MFA Rules not processed for user `a3826260d1944cfc9e99a218bb82d073`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:50.548629 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:50.611881 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1327/2644] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:50.616318 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.679435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5ac1-cc09-473b-9fa8-ee4c933954a6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.684167 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.684948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.685238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.685517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.686208 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.688690 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.764462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1318/2645] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:50 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:50.769027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.779445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d0fdf-e77b-4972-8d9d-6d771b0d904d None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.834991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.835680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.835964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.836238 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.836922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.838828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.954781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1328/2646] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:50 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:50.958706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:50.968781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c5c79-1bf3-4a75-901a-0aaf5f0972fd admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:50.973305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:50.973954 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:50.974234 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:50.974507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:50.975213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:50.976891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:50.988015 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1319/2647] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:50.991996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:51.002456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17246b-adf9-4650-a81f-7b9ee5f1a677 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:51.007050 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:51.007942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.008224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.008501 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] PATH_INFO: `/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56/users/f779942545f94cfd934b130fc891fad8/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.022573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc93ef3f9d9c4caaa340e7a1a2248f56, user_id=f779942545f94cfd934b130fc891fad8, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:51.025225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:51.127626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1329/2648] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:50 2022] PUT /identity/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56/users/f779942545f94cfd934b130fc891fad8/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:51.131506 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:51.141341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26346-156e-4aef-8442-2f0e89778e93 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:51.204126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:51.204959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.205100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.205350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.206073 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:51.207706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c48b6-022b-42d3-8243-b51dfdf17d2d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:51.217762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1320/2649] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:51.222602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:51.233212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecccd-eac8-4f2e-99b3-a68161d2ede5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:51.238834 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:51.239751 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.240036 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.240312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] PATH_INFO: `/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56/users/f779942545f94cfd934b130fc891fad8/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.242279 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc93ef3f9d9c4caaa340e7a1a2248f56, user_id=f779942545f94cfd934b130fc891fad8, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:51.244948 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:51.256355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1330/2650] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:51 2022] PUT /identity/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56/users/f779942545f94cfd934b130fc891fad8/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:51.266685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.266862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.267144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.296689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] MFA Rules not processed for user `f779942545f94cfd934b130fc891fad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:51.298911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:51.376578 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1321/2651] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:51.384470 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:51.386579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:51.455706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6abe0-a26d-4c46-9dfb-29bee203b24b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:51.458303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:51.458951 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.459233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.459543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.468572 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:51.470597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:51.480016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1331/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:51.679150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:51.683983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:51.692799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4a9b6-6a1d-4a4a-a0d1-c382dcb353e3 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:51.696496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:51.697196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:51.697479 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:51.697753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:51.757260 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:51.758644 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f3ff2-7392-4c97-933f-25b8cf50b334 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:51.769983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1322/2653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:27:55.214270 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:55.273779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76488-e6db-4d49-9642-c189fac592e0 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:55.278450 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:55.279313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:55.279626 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:55.280097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] PATH_INFO: `/v3/users/a3826260d1944cfc9e99a218bb82d073` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:55.281338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3826260d1944cfc9e99a218bb82d073)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:55.284193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:55.442727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3826260d1944cfc9e99a218bb82d073'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:55.449763 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3826260d1944cfc9e99a218bb82d073'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:55.461771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3826260d1944cfc9e99a218bb82d073'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:55.546246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3826260d1944cfc9e99a218bb82d073'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:55.546903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3826260d1944cfc9e99a218bb82d073'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:55.553251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1332/2654] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:55 2022] DELETE /identity/v3/users/a3826260d1944cfc9e99a218bb82d073 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:55.557728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:55.559695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:55.559695 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:55.575873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:55.577122 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:55.602902 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:55.604390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:55.636352 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1323/2655] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:27:55.646240 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:55.647616 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:55.661125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159dd3-d37e-4462-a489-c10ef43b377f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:55.664810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:55.665454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:55.665738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:55.666015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:55.667828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:55.708054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14f165-7f9c-4397-a0ba-c02a2c434352 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:55.712825 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:55.713958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:55.714246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:55.714591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:55.724568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:55.726023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:55.732652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:55.734096 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:55.735431 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1324/2656] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:55.746291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1333/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:27:56.288772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:56.292060 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:56.305028 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f49b-98a6-49eb-98d2-3136e7836709 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:56.310035 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:56.310910 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:56.311232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:56.311577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] PATH_INFO: `/v3/projects/16a2cf813b5a4754807a9b1733cfd872` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:56.313470 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a2cf813b5a4754807a9b1733cfd872)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:56.315630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:56.421246 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a2cf813b5a4754807a9b1733cfd872', 'request_id': 'req-72e0ca16-d829-4cb2-8459-6af1421adb2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.427338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a2cf813b5a4754807a9b1733cfd872', 'request_id': 'req-72e0ca16-d829-4cb2-8459-6af1421adb2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.495154 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a2cf813b5a4754807a9b1733cfd872', 'request_id': 'req-72e0ca16-d829-4cb2-8459-6af1421adb2d'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.507210 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] The token cache is being invalidate because project 16a2cf813b5a4754807a9b1733cfd872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:56.507520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.508170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.509804 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1325/2658] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:56 2022] DELETE /identity/v3/projects/16a2cf813b5a4754807a9b1733cfd872 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:56.514119 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:56.524516 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12845-645b-4bab-9c22-c6eaa66590a0 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:56.580846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:56.581738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:56.582019 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:56.582298 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] PATH_INFO: `/v3/users/f779942545f94cfd934b130fc891fad8` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:56.583645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f779942545f94cfd934b130fc891fad8)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:56.585618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:56.758280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f779942545f94cfd934b130fc891fad8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.765005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f779942545f94cfd934b130fc891fad8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.777492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f779942545f94cfd934b130fc891fad8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.860873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f779942545f94cfd934b130fc891fad8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.861492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-fb111d86-405d-40fe-93f6-c69b09e55d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f779942545f94cfd934b130fc891fad8'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:56.868418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1334/2659] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:27:56 2022] DELETE /identity/v3/users/f779942545f94cfd934b130fc891fad8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:57.356916 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:57.358500 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:57.372711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ca16-d829-4cb2-8459-6af1421adb2d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:57.445736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:57.447029 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:57.447696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:57.447696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] PATH_INFO: `/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:57.448854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc93ef3f9d9c4caaa340e7a1a2248f56)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:57.450965 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:57.565453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc93ef3f9d9c4caaa340e7a1a2248f56', 'request_id': 'req-71c5ea78-8cdc-44d6-ae68-8f825ceced50'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:57.570850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc93ef3f9d9c4caaa340e7a1a2248f56', 'request_id': 'req-71c5ea78-8cdc-44d6-ae68-8f825ceced50'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:57.640966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc93ef3f9d9c4caaa340e7a1a2248f56', 'request_id': 'req-71c5ea78-8cdc-44d6-ae68-8f825ceced50'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:57.652438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] The token cache is being invalidate because project fc93ef3f9d9c4caaa340e7a1a2248f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:27:57.658443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:57.658443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-71c5ea78-8cdc-44d6-ae68-8f825ceced50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:27:57.658443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1326/2660] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:27:57 2022] DELETE /identity/v3/projects/fc93ef3f9d9c4caaa340e7a1a2248f56 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:57.660580 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:57.661035 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:57.661141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:57.680135 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:57.681433 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:57.741326 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1335/2661] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:57.752203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:57.752491 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:57.752762 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:57.775376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:57.776597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:57.785459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1327/2662] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:57.789586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:57.799465 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf05c-4e26-41a7-a356-9a6056161f56 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:57.804008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:57.804662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:57.804941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:57.805214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:57.805938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:27:57.806234 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:57.807872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:57.823577 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1336/2663] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:27:57.824655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:57.833999 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749743e1-e88f-4623-9391-b7a1f4bb43a6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:57.838713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:57.839363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:57.839684 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:57.839961 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:57.840798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:57.842702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:57.937044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1328/2664] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:57 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:57.938533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:57.948552 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4123-d002-4a37-92e0-6c27172cf5d7 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.008623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.009299 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.009587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.009886 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.010624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.012597 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.118787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1337/2665] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:57 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:58.122771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.133276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d3b8-755d-45e2-b290-bd0d95307827 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.138366 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.139050 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.139546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.139834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.140589 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.142248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.159534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1329/2666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:58.160816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.171077 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0e5-ad18-4245-9d62-3c238bd1515e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.186066 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.186848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.187152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.187410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.190258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.192015 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f88c2-d1d7-470e-b2f5-ce8b528929f9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.203959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1338/2667] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:58.209829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.219370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726534-cf0e-4296-bd67-2c586c676cd3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.229459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.234416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.234416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.234416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] PATH_INFO: `/v3/projects/77b11f33e8004069b9d141fd8efb99ea/users/6463dd1d08514387869825be831d63ff/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.272474 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b11f33e8004069b9d141fd8efb99ea, user_id=6463dd1d08514387869825be831d63ff, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.275339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.374425 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1330/2668] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:58 2022] PUT /identity/v3/projects/77b11f33e8004069b9d141fd8efb99ea/users/6463dd1d08514387869825be831d63ff/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:58.384623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.385313 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.385946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.417604 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] MFA Rules not processed for user `6463dd1d08514387869825be831d63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:58.419193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:58.502983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1339/2669] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:58.504583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.608982 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c6bd-99a7-4094-ab44-51b417836aff admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.617272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.617947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.619045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.619329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.620057 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.622070 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.756636 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1331/2670] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:27:58 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:27:58.760459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.773106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e159-7925-4c9f-b749-91ef14b03d57 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.856241 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.856923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.857211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.857488 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.858189 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.860186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.952212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1340/2671] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:27:58 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:27:58.956558 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:58.967023 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f7aa-032b-46bd-b695-ebdb5dd7b9ff admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:58.972013 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:58.972686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:58.973136 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:58.973324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:58.974230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:58.975944 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:58.990809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1332/2672] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:58.994174 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:59.007292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf7b9-a436-48fe-81c7-a4e14bd8b306 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:59.016240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:59.017461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:59.017770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:59.018041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] PATH_INFO: `/v3/projects/1d6752ba012b4925803386c20a8b9c66/users/340aba24d80242e7afeea32bdfeff3a7/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:59.039702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6752ba012b4925803386c20a8b9c66, user_id=340aba24d80242e7afeea32bdfeff3a7, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:59.042439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:59.126162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1341/2673] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:58 2022] PUT /identity/v3/projects/1d6752ba012b4925803386c20a8b9c66/users/340aba24d80242e7afeea32bdfeff3a7/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:59.128275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:59.145469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680a95-61d6-4e63-a41e-f518ce49ba17 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:59.237045 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:59.238271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:59.238785 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:59.239434 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:59.240776 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:59.243089 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ba13-56dc-4202-9ed8-5103dae0aa0e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:59.261169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1333/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:27:59.262856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:59.275292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93cf6-8c03-4654-8cb1-90fc4d09bc5b admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:59.284309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:59.285217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:59.285497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:59.285770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] PATH_INFO: `/v3/projects/1d6752ba012b4925803386c20a8b9c66/users/340aba24d80242e7afeea32bdfeff3a7/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:59.289454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6752ba012b4925803386c20a8b9c66, user_id=340aba24d80242e7afeea32bdfeff3a7, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:59.293360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:59.306862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1342/2675] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:27:59 2022] PUT /identity/v3/projects/1d6752ba012b4925803386c20a8b9c66/users/340aba24d80242e7afeea32bdfeff3a7/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:27:59.325051 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:59.325344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:59.325613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:59.353843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] MFA Rules not processed for user `340aba24d80242e7afeea32bdfeff3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:27:59.355049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:59.427705 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1334/2676] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:27:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:27:59.440323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:27:59.448476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:27:59.500578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a6e69-4d67-4677-9746-9670a2a2fd9a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:27:59.504606 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:27:59.506126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:27:59.506126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:27:59.506126 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:27:59.516556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:27:59.518090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:27:59.528274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1343/2677] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:27:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:00.426528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:00.429378 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5e1b-27a5-43eb-b710-4771a60e90d8 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:00.434269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340aba24d80242e7afeea32bdfeff3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d6752ba012b4925803386c20a8b9c66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:00.434920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:00.435203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:00.435496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:00.436273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:00.436581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:00.438238 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:00.451714 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1335/2678] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:28:00.455055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:00.463855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec24c9-9db1-41dc-be8c-5857ca744c17 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:00.468384 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340aba24d80242e7afeea32bdfeff3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d6752ba012b4925803386c20a8b9c66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:00.469115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:00.469461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:00.469805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:00.470497 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:00.472431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:00.585136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1344/2679] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:28:00 2022] POST /identity/v3/projects => generated 354 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:28:00.589261 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:00.598909 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a1c2-d890-4002-b53b-659096186a0f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:00.654746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340aba24d80242e7afeea32bdfeff3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d6752ba012b4925803386c20a8b9c66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:00.655438 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:00.655760 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:00.656040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:00.656829 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:00.657138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:00.659027 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:00.670161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1336/2680] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:28:00.705441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:00.715851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8e95-ae71-4f15-b5d6-097d73096e7f tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:00.720526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340aba24d80242e7afeea32bdfeff3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d6752ba012b4925803386c20a8b9c66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:00.721371 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:00.721653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:00.721960 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] PATH_INFO: `/v3/projects/cb3eab18a5b44907b371b201d578e9c2` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:00.723128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb3eab18a5b44907b371b201d578e9c2)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:00.725061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:00.853890 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3eab18a5b44907b371b201d578e9c2', 'request_id': 'req-c98fb0a4-14e8-48df-8741-b9d2b28293cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:00.859136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3eab18a5b44907b371b201d578e9c2', 'request_id': 'req-c98fb0a4-14e8-48df-8741-b9d2b28293cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:00.940271 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3eab18a5b44907b371b201d578e9c2', 'request_id': 'req-c98fb0a4-14e8-48df-8741-b9d2b28293cc'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:00.951969 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] The token cache is being invalidate because project cb3eab18a5b44907b371b201d578e9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:00.952257 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:00.952939 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c98fb0a4-14e8-48df-8741-b9d2b28293cc tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:00.954567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1345/2681] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:00 2022] DELETE /identity/v3/projects/cb3eab18a5b44907b371b201d578e9c2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:01.552183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:01.554235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:01.617049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c84f9-1ab7-48cf-8be0-b8f14387e6d1 tempest-VolumeQuotaClassesTest-1871893079 tempest-VolumeQuotaClassesTest-1871893079-project-admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:01.673544 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932799-a993-49e7-909a-931379ca451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:01.674409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932799-a993-49e7-909a-931379ca451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:01.674687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932799-a993-49e7-909a-931379ca451b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:01.674957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932799-a993-49e7-909a-931379ca451b admin admin] PATH_INFO: `/v3/users/6463dd1d08514387869825be831d63ff` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:01.676148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932799-a993-49e7-909a-931379ca451b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6463dd1d08514387869825be831d63ff)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:01.679984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932799-a993-49e7-909a-931379ca451b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:01.893121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6463dd1d08514387869825be831d63ff'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:01.894437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6463dd1d08514387869825be831d63ff'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:01.900984 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6463dd1d08514387869825be831d63ff'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:01.912368 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6463dd1d08514387869825be831d63ff'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:01.974514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6463dd1d08514387869825be831d63ff'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:01.980725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1337/2682] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:01 2022] DELETE /identity/v3/users/6463dd1d08514387869825be831d63ff => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:01.985332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:01.985827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:01.985942 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:02.004046 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:02.005801 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:02.061147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1346/2683] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:02.071406 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:02.072835 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:02.130647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932799-a993-49e7-909a-931379ca451b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:02.134272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:02.134913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:02.135196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:02.135493 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:02.144734 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:02.146105 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:02.155772 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1338/2684] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:02.552973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:02.554489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:02.567034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807070b-4f85-40a2-a0fa-ff4bc6918639 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:02.572193 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:02.573164 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:02.573369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:02.573720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] PATH_INFO: `/v3/projects/77b11f33e8004069b9d141fd8efb99ea` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:02.575040 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b11f33e8004069b9d141fd8efb99ea)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:02.577179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:02.694395 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b11f33e8004069b9d141fd8efb99ea', 'request_id': 'req-7dd1238f-25af-4759-b490-0d824c8691aa'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:02.699723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b11f33e8004069b9d141fd8efb99ea', 'request_id': 'req-7dd1238f-25af-4759-b490-0d824c8691aa'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:02.757977 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b11f33e8004069b9d141fd8efb99ea', 'request_id': 'req-7dd1238f-25af-4759-b490-0d824c8691aa'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:02.769492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] The token cache is being invalidate because project 77b11f33e8004069b9d141fd8efb99ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:02.769761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:02.770394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:02.771976 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1347/2685] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:02 2022] DELETE /identity/v3/projects/77b11f33e8004069b9d141fd8efb99ea => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:02.776107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:02.785848 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8219e8-e249-4fcf-b4b8-ad294f398631 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:02.841163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:02.842030 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:02.842310 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:02.842611 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] PATH_INFO: `/v3/users/340aba24d80242e7afeea32bdfeff3a7` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:02.843810 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=340aba24d80242e7afeea32bdfeff3a7)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:02.845709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:03.025335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340aba24d80242e7afeea32bdfeff3a7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.025990 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340aba24d80242e7afeea32bdfeff3a7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.032629 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340aba24d80242e7afeea32bdfeff3a7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.044445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340aba24d80242e7afeea32bdfeff3a7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.105560 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-476888c5-76cf-433e-9919-d4ce32e53d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340aba24d80242e7afeea32bdfeff3a7'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.111630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1339/2686] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:02 2022] DELETE /identity/v3/users/340aba24d80242e7afeea32bdfeff3a7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:03.505388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:03.507431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:03.522837 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1238f-25af-4759-b490-0d824c8691aa admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:03.581586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:03.582469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:03.582748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:03.583021 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] PATH_INFO: `/v3/projects/1d6752ba012b4925803386c20a8b9c66` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:03.584214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6752ba012b4925803386c20a8b9c66)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:03.586098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:03.705707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6752ba012b4925803386c20a8b9c66', 'request_id': 'req-5493cf6b-b163-43c6-b19a-77d78536c0a0'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.710821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6752ba012b4925803386c20a8b9c66', 'request_id': 'req-5493cf6b-b163-43c6-b19a-77d78536c0a0'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.780911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6752ba012b4925803386c20a8b9c66', 'request_id': 'req-5493cf6b-b163-43c6-b19a-77d78536c0a0'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.792889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] The token cache is being invalidate because project 1d6752ba012b4925803386c20a8b9c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:03.795852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.795852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5493cf6b-b163-43c6-b19a-77d78536c0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:03.795852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1348/2687] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:03 2022] DELETE /identity/v3/projects/1d6752ba012b4925803386c20a8b9c66 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:03.801039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:03.801496 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:03.801591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:03.820417 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:03.824640 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:03.878723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1340/2688] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:03.886590 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:03.886882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:03.887211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:03.905378 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:03.906578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:03.915192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1349/2689] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:03.919316 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:03.929339 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b21b7-5483-4952-8977-623d15e2cd87 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:03.933862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:03.934501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:03.934779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:03.935052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:03.935790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:03.936095 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:03.937712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:03.948904 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1341/2690] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:28:03.953041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:03.962055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6528eb-eceb-4e19-be7f-1290a14be894 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:03.966664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:03.967309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:03.967627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:03.967903 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:03.968813 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:03.970514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:03.983586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:03.985407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:03.998651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9127-5456-4e28-b7fd-e6248da64f3d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.003262 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.004151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.004437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.004712 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] PATH_INFO: `/v3/users/af939fb3139647fa873a2b9fbefd2566` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.005948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af939fb3139647fa873a2b9fbefd2566)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.007893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.083093 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1350/2691] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:28:03 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:28:04.086317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.144556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83ff49-d90f-4206-a6c6-304be872e069 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.149146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.149795 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.150076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.150352 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.151018 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.152946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.253834 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af939fb3139647fa873a2b9fbefd2566'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.254490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af939fb3139647fa873a2b9fbefd2566'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.260821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1351/2692] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:28:04 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:28:04.261301 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af939fb3139647fa873a2b9fbefd2566'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.262030 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.263706 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:04.273833 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af939fb3139647fa873a2b9fbefd2566'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.276435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bb3a0-a02f-49d7-88d8-9f797c07aa2a admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.281546 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.282243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.287686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.287979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.288748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.290369 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.300509 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1352/2693] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:04.304284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.313426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0767b-c427-4c4d-abe4-3f25142030d4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.318032 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.318643 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.318923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.319195 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.319956 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.321473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.332217 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1353/2694] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:04.339121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.345025 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd9fb-79b7-44c7-8573-900acf6cab14 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.350114 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.350946 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.351228 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.351529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] PATH_INFO: `/v3/projects/8c475c978ec8473da58fa8008a1f99e9/users/8e72a96fca2442c9ae11539a2af21078/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.357214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3c54de24-8fe5-4ea9-9f32-b7371b840d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af939fb3139647fa873a2b9fbefd2566'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.363437 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1342/2695] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:03 2022] DELETE /identity/v3/users/af939fb3139647fa873a2b9fbefd2566 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:04.365565 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c475c978ec8473da58fa8008a1f99e9, user_id=8e72a96fca2442c9ae11539a2af21078, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.367643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.373594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.373594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.373804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232978c-4f80-4048-805f-be3bd2683092 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.385126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:04.386322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:04.443420 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1343/2696] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:04.452900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.454278 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:04.458658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1354/2697] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:28:04 2022] PUT /identity/v3/projects/8c475c978ec8473da58fa8008a1f99e9/users/8e72a96fca2442c9ae11539a2af21078/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:04.469060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.469607 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.469893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.495661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] MFA Rules not processed for user `8e72a96fca2442c9ae11539a2af21078`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:04.496845 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:04.508969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b990e-e969-4c0b-bcbe-c35c18cf447e None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.554918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.555588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.555867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.556142 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.558693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1355/2698] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:04.569819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.571138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:04.614561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.615959 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.625715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1344/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:28:04.625863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9cc54-db9f-4574-ab25-03cfd42f481e None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.630079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.630725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.631013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.631293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.639901 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.641339 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99deb-e633-4e70-b1b6-6bcbe7f7ef90 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.650712 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1356/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:28:04.669228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:04.678821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e670f4-3f17-463b-9164-7d6ce8c66d33 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:04.683572 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:04.689008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.689008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.689008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] PATH_INFO: `/v3/users/8e72a96fca2442c9ae11539a2af21078` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.689008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e72a96fca2442c9ae11539a2af21078)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:04.689008 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:04.860254 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e72a96fca2442c9ae11539a2af21078'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.861237 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e72a96fca2442c9ae11539a2af21078'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.868852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e72a96fca2442c9ae11539a2af21078'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.881018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e72a96fca2442c9ae11539a2af21078'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.937942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e72a96fca2442c9ae11539a2af21078'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:04.944795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1345/2701] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:04 2022] DELETE /identity/v3/users/8e72a96fca2442c9ae11539a2af21078 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:04.949211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:04.949506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:04.949784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:04.968658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:04.969848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.026804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1357/2702] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:05.036805 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.038198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.059600 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.061074 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.074596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8faa6-c25b-47e2-bb1a-feb7f086c231 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.079527 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.080422 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.080707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.081010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] PATH_INFO: `/v3/projects/893db4fe55a04d42a6169ae62ff21bbc` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.082207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=893db4fe55a04d42a6169ae62ff21bbc)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.084181 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.100711 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633b5b-8ebe-4e44-b771-6a7c06ce270b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.104415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.105062 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.105344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.105619 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.119566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.119566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820acff-c132-4542-be63-e1f047e63cf5 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.126416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1346/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:05.224229 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893db4fe55a04d42a6169ae62ff21bbc', 'request_id': 'req-368b819a-ced6-4be2-95cb-c3b916a5c4e3'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.229667 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893db4fe55a04d42a6169ae62ff21bbc', 'request_id': 'req-368b819a-ced6-4be2-95cb-c3b916a5c4e3'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.297959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893db4fe55a04d42a6169ae62ff21bbc', 'request_id': 'req-368b819a-ced6-4be2-95cb-c3b916a5c4e3'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.309817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] The token cache is being invalidate because project 893db4fe55a04d42a6169ae62ff21bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:05.310107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.310873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-368b819a-ced6-4be2-95cb-c3b916a5c4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.312695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1358/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:05 2022] DELETE /identity/v3/projects/893db4fe55a04d42a6169ae62ff21bbc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:05.318125 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.318461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.322781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.341163 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:05.342383 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.402403 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1347/2705] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:05.410894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.411267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.411650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.431364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:05.433179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.440686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1359/2706] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:05.444876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.454235 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec7ab-8c2d-497c-a911-0425a8ab7bff None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.458822 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.459492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.459779 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.460059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.460784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:05.461088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.462675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.474655 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1348/2707] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:28:05.478992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.489034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b52eb-ef32-4d0b-ba38-00d3555ed344 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.493882 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.494523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.494806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.495085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.495860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.500389 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.522646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.524453 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.538211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f486c98-e627-4814-87b1-2b7ef8a80e78 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.542945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.543978 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.544251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.544525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] PATH_INFO: `/v3/projects/8c475c978ec8473da58fa8008a1f99e9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.545729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c475c978ec8473da58fa8008a1f99e9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.547741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.585075 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1360/2708] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:28:05.589161 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.648184 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291fcd-e4aa-437c-bd22-c89c70f49c1f admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.652865 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.653522 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.653817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.654090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.654785 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.656748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.675100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c475c978ec8473da58fa8008a1f99e9', 'request_id': 'req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.680985 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c475c978ec8473da58fa8008a1f99e9', 'request_id': 'req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.765291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1361/2709] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:28:05.769554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.779000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b9906-1e45-43a0-b010-e7c9b7601e66 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.785753 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c475c978ec8473da58fa8008a1f99e9', 'request_id': 'req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.797575 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] The token cache is being invalidate because project 8c475c978ec8473da58fa8008a1f99e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:05.797864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.798556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-eb729c26-df69-4e52-8edb-9c3e64fcf8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:05.800141 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1349/2710] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:05 2022] DELETE /identity/v3/projects/8c475c978ec8473da58fa8008a1f99e9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:05.805439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.805726 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.806144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.824204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:05.825392 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.834300 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.834974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.835258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.835559 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.836287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.837904 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.847370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1362/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:05.851230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.852856 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.865123 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299251-eb43-47c6-88a7-6afc7ab5c916 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.869798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.870442 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.870720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.871000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.871770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.873343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c10a-9d7e-4083-bccd-ac7506bd8020 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.883857 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1350/2712] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:05.884539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1363/2713] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:05.890588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.892309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115116-c816-4639-8aef-259d73e50964 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.892596 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115116-c816-4639-8aef-259d73e50964 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.892873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115116-c816-4639-8aef-259d73e50964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.900465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b639d7-f2d3-4853-988a-c4c0a900e956 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.907884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.912245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.912245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.912245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] PATH_INFO: `/v3/projects/e9d9e05a42da4cca89db0be45ee523dc/users/3d3d003c1322456aaf3db0c0252f3b25/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.912549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-13115116-c816-4639-8aef-259d73e50964 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:05.913252 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-13115116-c816-4639-8aef-259d73e50964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:05.921338 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1364/2714] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:05.924709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d9e05a42da4cca89db0be45ee523dc, user_id=3d3d003c1322456aaf3db0c0252f3b25, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.925225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13115116-c816-4639-8aef-259d73e50964 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.927331 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6c85-98a3-4f62-b22b-1a87ab8693bc admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.933993 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13115116-c816-4639-8aef-259d73e50964 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.938586 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.940748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.940748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.940748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.940748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:05.941072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.942361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.953447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1365/2715] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:28:05.958094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:05.967592 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37a97a-fc4d-4079-833a-c7b372377a60 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:05.972214 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:05.973301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:05.973588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:05.973868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:05.974535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:05.976408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:05.997796 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1351/2716] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:28:05 2022] PUT /identity/v3/projects/e9d9e05a42da4cca89db0be45ee523dc/users/3d3d003c1322456aaf3db0c0252f3b25/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:06.009067 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.009355 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.009689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.036248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] MFA Rules not processed for user `3d3d003c1322456aaf3db0c0252f3b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:06.037442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.056872 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1366/2717] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:28:05 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:28:06.058160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.099533 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1352/2718] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:06.110484 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.111830 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.118594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6492ba-463d-49f1-9606-23c3bce4911e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.123224 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.123940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.124356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.124664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.125343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.127308 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.165997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1845d-6c81-47d1-9e3b-c0f08a5ddfd6 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.206348 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1367/2719] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:28:06 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:28:06.208365 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.213265 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.213941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.214228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.214523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.217928 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d93d-a2cf-4e8c-8655-12a32a9f790e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.222734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.223373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.223691 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.223974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.224688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.226276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.236049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1368/2720] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:06.241720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.251256 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2be2-f54e-4540-ac34-cfeaaebe3506 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.256728 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.257366 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.257649 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.257922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.258634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.260262 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.271166 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1369/2721] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:06.272243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.273751 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.276379 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.282849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1353/2722] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:28:06.285926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656e91-1aa8-44b1-b6e9-56596d93da60 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.290822 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.291713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.291997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.292276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] PATH_INFO: `/v3/projects/191f6e0f9a274f2a9d4b9ee658255748/users/7d416739b2264d0ca391455afa98b1c9/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.306908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.307543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191f6e0f9a274f2a9d4b9ee658255748, user_id=7d416739b2264d0ca391455afa98b1c9, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.310175 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c7dd-8459-4d39-be29-e1956cc53ab7 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.317986 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a52e-b75a-4b23-8e2f-845ae11f2edc service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.322545 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.323386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.324514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.324514 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] PATH_INFO: `/v3/users/3d3d003c1322456aaf3db0c0252f3b25` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.325342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3d003c1322456aaf3db0c0252f3b25)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.327220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.412515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1370/2723] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:28:06 2022] PUT /identity/v3/projects/191f6e0f9a274f2a9d4b9ee658255748/users/7d416739b2264d0ca391455afa98b1c9/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:06.417441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.417677 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.417990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.435439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:06.436693 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.493705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1371/2724] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:06.503058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.505023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.522201 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3d003c1322456aaf3db0c0252f3b25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:06.522893 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3d003c1322456aaf3db0c0252f3b25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:06.529838 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3d003c1322456aaf3db0c0252f3b25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:06.541442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3d003c1322456aaf3db0c0252f3b25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:06.560455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2ba4-b6ee-46d6-90ec-3086b2f05d23 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.564289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.565092 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.565601 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.566623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.569169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.584991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.586444 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a423bb-fa7b-4181-826e-81308fb64c0b service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.596317 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1372/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:06.608896 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3d003c1322456aaf3db0c0252f3b25'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:06.616519 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1354/2726] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:06 2022] DELETE /identity/v3/users/3d3d003c1322456aaf3db0c0252f3b25 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:06.620915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.621201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.621476 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.639162 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:06.640373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.706293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1373/2727] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:06.715886 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:06.717436 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:06.777043 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c43f-5bb9-4515-bf42-2021b12d3647 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:06.781256 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:06.781902 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:06.782188 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:06.782460 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:06.792068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:06.793527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e746f-662f-4463-88cd-60ac6fc6ca68 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:06.803752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1355/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:07.296190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:07.297863 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:07.310208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb980d5-0749-43ee-8af5-328e89aed245 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:07.315418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:07.316566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.316855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.317206 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] PATH_INFO: `/v3/projects/e9d9e05a42da4cca89db0be45ee523dc` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.318887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d9e05a42da4cca89db0be45ee523dc)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:07.320420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:07.431906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d9e05a42da4cca89db0be45ee523dc', 'request_id': 'req-9677b79c-1ff5-469f-b3e1-af18a6879545'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:07.437309 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d9e05a42da4cca89db0be45ee523dc', 'request_id': 'req-9677b79c-1ff5-469f-b3e1-af18a6879545'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:07.543683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d9e05a42da4cca89db0be45ee523dc', 'request_id': 'req-9677b79c-1ff5-469f-b3e1-af18a6879545'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:07.555547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] The token cache is being invalidate because project e9d9e05a42da4cca89db0be45ee523dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:07.555887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:07.556517 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-9677b79c-1ff5-469f-b3e1-af18a6879545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:07.558362 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1374/2729] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:07 2022] DELETE /identity/v3/projects/e9d9e05a42da4cca89db0be45ee523dc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:07.563192 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.563820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.563820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.584748 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:07.586026 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:07.642769 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1356/2730] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:07.651072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.651558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.651657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.669852 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:07.671147 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:07.679205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1375/2731] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:07.683321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:07.693272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2487c-7a70-4248-a777-3dfd011f8d2f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:07.697813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:07.698452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.698732 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.699006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.699784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:28:07.700088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:07.701662 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:07.713350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1357/2732] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:28:07.717588 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:07.726768 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3f84-7814-4bc5-8753-f268f10e8e38 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:07.731563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:07.732201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.732482 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.732757 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.733436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:07.735333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac9d49-eb4a-4368-8ecd-458ea5c0aa20 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:07.833210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1376/2733] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:28:07 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:28:07.834335 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:07.844413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bee4-e294-45c6-80a4-4bca989d35cb admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:07.859146 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.859443 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.859755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.886914 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] MFA Rules not processed for user `7d416739b2264d0ca391455afa98b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:07.888418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:07.909977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:07.910735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:07.911180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:07.912230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:07.913213 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:07.915091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:07.956396 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1377/2734] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:07.966894 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:07.968211 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:08.006884 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1358/2735] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:28:07 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:28:08.010809 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:08.021016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55a92-53c0-44ba-b06c-9649ea2e2c8c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:08.024980 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187473b7-2296-4086-adc9-cc1cf8625324 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:08.025952 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:08.026610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.026911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.027189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.027942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:08.029343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:08.029556 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:08.030277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.030622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.030990 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.040293 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:08.043668 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1359/2736] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:08.043798 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:08.044520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:08.051820 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1378/2737] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:28:08.054685 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c72f-9bf4-4473-85a3-d375c44d8d9d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:08.059409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:08.060091 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.060377 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.060653 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.061386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:08.063044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d662b26-050e-4d2c-a567-3e6e40f76473 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:08.074635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1360/2738] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:28:08.078562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:08.089690 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34d33-a476-4074-a3b5-4323effc290b service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:08.094458 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:08.096068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.096068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.096676 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] PATH_INFO: `/v3/projects/abb96d4d59e447e784b9acd685bcaf2f/users/32e0bc3412304944b2bca3f416316f39/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.110996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb96d4d59e447e784b9acd685bcaf2f, user_id=32e0bc3412304944b2bca3f416316f39, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:08.114240 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:08.183761 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1379/2739] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:28:08 2022] PUT /identity/v3/projects/abb96d4d59e447e784b9acd685bcaf2f/users/32e0bc3412304944b2bca3f416316f39/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:28:08.194702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5848-9d2e-445b-8f49-747df5726ff8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.194991 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5848-9d2e-445b-8f49-747df5726ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.195268 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5848-9d2e-445b-8f49-747df5726ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.220592 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-e5ae5848-9d2e-445b-8f49-747df5726ff8 None None] MFA Rules not processed for user `32e0bc3412304944b2bca3f416316f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:08.221781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e5ae5848-9d2e-445b-8f49-747df5726ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:08.284052 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1361/2740] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:28:08.294524 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:08.296296 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:08.352330 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5447-2a05-4f88-a070-19283ebe28b0 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:08.356085 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:08.356722 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:08.357008 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:08.357286 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:08.366087 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:08.371010 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:08.376445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1380/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:09.735239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37d30-01a0-4527-94ee-68a12f200ddc None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:09.735775 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37d30-01a0-4527-94ee-68a12f200ddc None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:09.735935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37d30-01a0-4527-94ee-68a12f200ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:09.755451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d0d37d30-01a0-4527-94ee-68a12f200ddc None None] MFA Rules not processed for user `7d416739b2264d0ca391455afa98b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:09.757172 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d0d37d30-01a0-4527-94ee-68a12f200ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:09.817222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1362/2742] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:19.612281 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:19.677006 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e594-cfe7-4001-a846-8059ebc09e8e service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:19.681500 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:19.682361 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:19.682645 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:19.682916 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] PATH_INFO: `/v3/users/32e0bc3412304944b2bca3f416316f39` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:19.684140 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e0bc3412304944b2bca3f416316f39)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:19.686109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:19.868157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e0bc3412304944b2bca3f416316f39'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:19.874860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e0bc3412304944b2bca3f416316f39'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:19.886628 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e0bc3412304944b2bca3f416316f39'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:19.977816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e0bc3412304944b2bca3f416316f39'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:19.978633 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e0bc3412304944b2bca3f416316f39'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:19.985023 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1381/2743] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:19 2022] DELETE /identity/v3/users/32e0bc3412304944b2bca3f416316f39 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:19.990033 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:19.990523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:19.990608 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:20.008738 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:20.009906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:20.068066 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1363/2744] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:20.077680 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:20.079076 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:20.134457 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b30ba-a4fc-4c78-8d0f-2f4f605474a6 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:20.138058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:20.138688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:20.138968 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:20.139242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:20.147921 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:20.149337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:20.158374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1382/2745] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:20.553568 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:20.555113 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:20.567116 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf868-1b98-4eaa-9d02-3f1b1ec31ad8 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:20.571948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:20.572962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:20.573269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:20.573680 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] PATH_INFO: `/v3/projects/abb96d4d59e447e784b9acd685bcaf2f` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:20.574929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb96d4d59e447e784b9acd685bcaf2f)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:20.576892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:20.676883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb96d4d59e447e784b9acd685bcaf2f', 'request_id': 'req-6da4ac2e-d17c-4175-a4d9-553b17985bdf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:20.682184 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb96d4d59e447e784b9acd685bcaf2f', 'request_id': 'req-6da4ac2e-d17c-4175-a4d9-553b17985bdf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:20.756761 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb96d4d59e447e784b9acd685bcaf2f', 'request_id': 'req-6da4ac2e-d17c-4175-a4d9-553b17985bdf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:20.767402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] The token cache is being invalidate because project abb96d4d59e447e784b9acd685bcaf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:20.767715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:20.768343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6da4ac2e-d17c-4175-a4d9-553b17985bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:20.770372 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1364/2746] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:20 2022] DELETE /identity/v3/projects/abb96d4d59e447e784b9acd685bcaf2f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:42.602883 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:42.604337 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:42.615802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f149db-76c6-49cd-bb43-87960f6426cb service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:42.663291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:42.663992 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:42.664272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:42.664542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:42.666277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:42.726466 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:42.727922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:42.737124 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1383/2747] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:28:49.745171 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:49.745648 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:49.745744 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:49.765801 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] MFA Rules not processed for user `b02cccd87bde482c98218ee27bf8facf`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:28:49.768241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:49.872947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1365/2748] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:28:50.432720 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:50.436987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:50.448289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b40ea-c3e8-4aad-83d2-65f3495a95e5 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:50.453225 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:50.454168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:50.454585 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:50.454873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] PATH_INFO: `/v3/users/14313ce3f35f4468add7fbc073f90f12` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:50.456571 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14313ce3f35f4468add7fbc073f90f12)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:50.458499 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:50.637095 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14313ce3f35f4468add7fbc073f90f12'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:50.644533 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14313ce3f35f4468add7fbc073f90f12'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:50.657239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14313ce3f35f4468add7fbc073f90f12'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:50.710918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14313ce3f35f4468add7fbc073f90f12'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:50.711558 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14313ce3f35f4468add7fbc073f90f12'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:50.717940 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1384/2749] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:50 2022] DELETE /identity/v3/users/14313ce3f35f4468add7fbc073f90f12 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:50.941282 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:50.958708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f3821-1613-4d79-b938-e4350c0ac652 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:51.016432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:51.017286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:51.017565 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:51.017836 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] PATH_INFO: `/v3/projects/b0a880bb2648415aa3ee1a89d71186f6` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:51.019016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a880bb2648415aa3ee1a89d71186f6)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:51.020950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:51.145793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a880bb2648415aa3ee1a89d71186f6', 'request_id': 'req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.151741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a880bb2648415aa3ee1a89d71186f6', 'request_id': 'req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.219975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a880bb2648415aa3ee1a89d71186f6', 'request_id': 'req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.231344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] The token cache is being invalidate because project b0a880bb2648415aa3ee1a89d71186f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:51.231665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.232290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.233858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1366/2750] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:50 2022] DELETE /identity/v3/projects/b0a880bb2648415aa3ee1a89d71186f6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:51.237913 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:51.239346 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:51.252459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ed74-503e-4edc-94aa-90a92784993e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:51.308055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:51.308920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:51.309207 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:51.309483 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] PATH_INFO: `/v3/users/cdd07436b7854da287ef51baac9231fd` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:51.310663 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd07436b7854da287ef51baac9231fd)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:51.312611 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:51.502278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd07436b7854da287ef51baac9231fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.509885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd07436b7854da287ef51baac9231fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.521136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd07436b7854da287ef51baac9231fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.585652 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd07436b7854da287ef51baac9231fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.586288 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e7d5f609-93c2-4568-ac31-bd5d808e6647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd07436b7854da287ef51baac9231fd'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:51.592410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1385/2751] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:28:51 2022] DELETE /identity/v3/users/cdd07436b7854da287ef51baac9231fd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:28:51.855729 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:28:51.857341 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:28:51.890337 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c55c-a1da-4848-99c3-c49d4d5e7eef admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:28:51.946581 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:28:51.947620 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:28:51.948047 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:28:51.948207 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] PATH_INFO: `/v3/projects/5f3ae0753ba64adf8b508e63b2542414` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:28:51.949617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3ae0753ba64adf8b508e63b2542414)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:28:51.951958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:28:52.108574 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3ae0753ba64adf8b508e63b2542414', 'request_id': 'req-0384b5ea-fecb-4449-91d3-bfdacbca66b9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:52.113686 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3ae0753ba64adf8b508e63b2542414', 'request_id': 'req-0384b5ea-fecb-4449-91d3-bfdacbca66b9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:52.176908 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3ae0753ba64adf8b508e63b2542414', 'request_id': 'req-0384b5ea-fecb-4449-91d3-bfdacbca66b9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:52.188623 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] The token cache is being invalidate because project 5f3ae0753ba64adf8b508e63b2542414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:28:52.188915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:52.189564 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:28:52.191198 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1367/2752] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:28:51 2022] DELETE /identity/v3/projects/5f3ae0753ba64adf8b508e63b2542414 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:29:19.785190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:29:19.785702 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:29:19.785806 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:29:19.803804 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] MFA Rules not processed for user `7d416739b2264d0ca391455afa98b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:29:19.805004 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:29:19.856832 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1386/2753] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:29:44.635200 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:29:44.636664 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:29:44.691974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b5ea-fecb-4449-91d3-bfdacbca66b9 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:29:44.695538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:29:44.696173 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:29:44.696452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:29:44.696725 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:29:44.698482 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:29:44.765976 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:29:44.767405 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:29:44.778178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1368/2754] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:29:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:29:52.883650 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:29:52.885157 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:29:52.897618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507550f3-45de-4f0e-b0ba-8dae4dce2918 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:29:52.901216 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:29:52.901850 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:29:52.902132 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:29:52.902404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:29:52.904179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:29:52.917267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:29:52.918683 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:29:52.929729 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1387/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:29:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:13.124229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:13.125773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:13.139850 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f9610-2109-4104-ab88-0c0d7dfb01a7 service cinder] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:13.145428 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:13.146059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:13.146342 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:13.146860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:13.148388 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:13.205510 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:13.207087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:13.215852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1369/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:30:16.758481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:16.760106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:16.776107 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feec1a-5944-45af-81ae-4d5bb86e1e0c service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:16.807685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:16.809084 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:16.809548 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:16.809979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:16.812125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:16.835303 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:16.837661 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:16.852083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1388/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:17.506145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:17.507610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:17.576940 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215b15-4d51-43b7-af25-7fdffb4326c5 service nova] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:17.582656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:17.583509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:17.583682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:17.583967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:17.586190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:17.596687 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:17.598195 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:17.606755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1370/2758] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:21.777891 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:21.787723 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa3da2-cdd1-4640-b002-7fbc4ebb6c59 service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:21.791409 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:21.792082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:21.792368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:21.792644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:21.794491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:21.804276 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:21.812125 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:21.814556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1389/2759] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:21.896720 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:21.905476 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935813-0be7-4b55-a191-9378ccf50171 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:21.909322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:21.910241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:21.910504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:21.910781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:21.913156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:21.926951 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:21.928432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:21.939710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1371/2760] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:22.004964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:22.006383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:22.077844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf7d6-9894-4db2-9ad1-706057f3ffb5 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:22.083564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:22.084278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:22.084567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:22.084842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:22.086906 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:22.098954 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:22.100566 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:22.110908 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1390/2761] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:22.652196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:22.653689 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:22.665267 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dab3-10d5-481a-84af-4d5f546f0a3c service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:22.669373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:22.669998 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:22.670275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:22.670551 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:22.672289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:22.737981 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:22.739432 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:22.748967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1372/2762] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:23.747058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:23.762895 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c9ec-b391-473b-8494-d280673761e8 service placement] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:23.769732 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:23.770974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:23.771345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:23.772012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:23.774080 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:23.789561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:23.800185 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:23.820748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1391/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:26.767795 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:26.769427 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:26.785899 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e082-80a2-4f9a-96d6-0baf0d7898a0 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:26.791009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:26.794127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:26.794127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:26.794127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] PATH_INFO: `/v3/users/7d416739b2264d0ca391455afa98b1c9` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:26.794462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d416739b2264d0ca391455afa98b1c9)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:26.796656 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:26.997710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d416739b2264d0ca391455afa98b1c9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:26.997710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d416739b2264d0ca391455afa98b1c9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.005041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d416739b2264d0ca391455afa98b1c9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.017090 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d416739b2264d0ca391455afa98b1c9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.076001 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d416739b2264d0ca391455afa98b1c9'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.085862 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1373/2764] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:26 2022] DELETE /identity/v3/users/7d416739b2264d0ca391455afa98b1c9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:27.276274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.277907 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:27.291988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52792f-0723-420e-b064-2419e3d574ab service nova] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:27.345920 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:27.346866 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.347001 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.347280 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] PATH_INFO: `/v3/users/b02cccd87bde482c98218ee27bf8facf` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.348513 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02cccd87bde482c98218ee27bf8facf)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:27.352797 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:27.354144 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.355798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:27.372037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8384d2-349c-44a4-9711-c82dbd0b0dee admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:27.377671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:27.378562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.378849 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.379716 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] PATH_INFO: `/v3/projects/191f6e0f9a274f2a9d4b9ee658255748` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.380932 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191f6e0f9a274f2a9d4b9ee658255748)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:27.382883 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:27.515922 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02cccd87bde482c98218ee27bf8facf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.517569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191f6e0f9a274f2a9d4b9ee658255748', 'request_id': 'req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.523617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02cccd87bde482c98218ee27bf8facf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.524133 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191f6e0f9a274f2a9d4b9ee658255748', 'request_id': 'req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.536844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02cccd87bde482c98218ee27bf8facf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.569790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191f6e0f9a274f2a9d4b9ee658255748', 'request_id': 'req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.581350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] The token cache is being invalidate because project 191f6e0f9a274f2a9d4b9ee658255748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:27.581634 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.582243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-e4bc64f9-d8b4-4fbc-8768-21c28353ab36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.583846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1374/2765] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:27 2022] DELETE /identity/v3/projects/191f6e0f9a274f2a9d4b9ee658255748 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:27.588499 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.588763 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.589037 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.609663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:27.609663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:27.643727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02cccd87bde482c98218ee27bf8facf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.644354 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-2b0aa39c-44c8-47d0-8c1f-6079ffea87b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02cccd87bde482c98218ee27bf8facf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:27.650725 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1392/2766] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:27 2022] DELETE /identity/v3/users/b02cccd87bde482c98218ee27bf8facf => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:27.665597 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1375/2767] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:27.675212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.675536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.675821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.696451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:27.696451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:27.754081 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1393/2768] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:27.758350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.768798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89ad9-fa3b-47af-a0bb-dff6ee957fe5 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:27.774098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:27.774841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.775189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.775576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.776365 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:27.776741 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:27.778357 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:27.794542 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1376/2769] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:30:27.796094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.806758 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e09705-d80e-4796-9061-8b4bb1be712f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:27.816086 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:27.822659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.822659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.822659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.822659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:27.822659 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:27.940766 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.942663 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:27.959591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c21f3f-fea5-4308-943d-b602a84d98c0 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:27.967503 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1394/2770] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:27 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:27.971693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:27.971693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:27.971693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:27.971693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] PATH_INFO: `/v3/projects/e4cb80aa86f846cabcbee099dd90a3ca` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:27.972117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cb80aa86f846cabcbee099dd90a3ca)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:27.972202 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:27.972289 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.031949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd055-d66b-406b-98d9-a3617d80f996 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.037016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.037686 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.037970 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.038246 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.038941 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.040998 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.075700 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cb80aa86f846cabcbee099dd90a3ca', 'request_id': 'req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:28.084344 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cb80aa86f846cabcbee099dd90a3ca', 'request_id': 'req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:28.204054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1395/2771] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:27 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:28.208186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.217727 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9933-492a-46d2-a566-96415f5a0254 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.218231 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cb80aa86f846cabcbee099dd90a3ca', 'request_id': 'req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:28.230158 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] The token cache is being invalidate because project e4cb80aa86f846cabcbee099dd90a3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:28.230442 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:28.231119 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-f2f9e0a0-ba8f-477b-98d0-824c9f9bea18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:28.232693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1377/2772] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:27 2022] DELETE /identity/v3/projects/e4cb80aa86f846cabcbee099dd90a3ca => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:28.238020 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6c4-f412-4866-9100-324c5e73c81b None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.238333 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6c4-f412-4866-9100-324c5e73c81b None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.238613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6c4-f412-4866-9100-324c5e73c81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.256635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a1e5e6c4-f412-4866-9100-324c5e73c81b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:28.257841 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a1e5e6c4-f412-4866-9100-324c5e73c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.273098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.273098 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.273373 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.273582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.274243 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.275873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.286165 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1396/2773] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:30:28.290665 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.291802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.304295 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792a26-236b-4559-b00a-de7b199074c4 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.309049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.309697 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.309985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.310269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.310985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.312599 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.316021 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1378/2774] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:28.323573 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.323865 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.324140 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.326564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1397/2775] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:28.327377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.337747 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d2599-e638-415c-83e6-ae233b39bce0 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.342455 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.343024 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:28.343324 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.343648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.343923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] PATH_INFO: `/v3/projects/fabc86b427c04f8984d07cadb14de587/users/3adab342a360456793dc320c9f32395c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.344251 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.352309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1379/2776] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:28.356096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.358789 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc86b427c04f8984d07cadb14de587, user_id=3adab342a360456793dc320c9f32395c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.361997 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4e47-36c8-4047-a7ec-9317c683c58f admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.365103 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cdb18-d8ab-4df5-9259-54312dbc43bf None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.369758 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.370407 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.370696 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.371071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.371856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:28.372169 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.373788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.385992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1380/2777] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:30:28.392007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.401354 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59256a-8c0f-4d1b-9d1b-98dcc0d45612 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.405846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.406523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.406802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.407211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.407920 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.409788 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.447423 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1398/2778] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:28 2022] PUT /identity/v3/projects/fabc86b427c04f8984d07cadb14de587/users/3adab342a360456793dc320c9f32395c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:28.459410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.459748 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.460027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.486974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] MFA Rules not processed for user `3adab342a360456793dc320c9f32395c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:28.488278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.534569 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1381/2779] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:30:28.539044 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.550473 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1399/2780] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:28.561061 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.562391 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.599079 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5045c-2356-49f6-aa60-dbe9b73d9257 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.604151 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.604816 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.605109 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.605373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.606049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.607988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.617462 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adb8cb-507c-4617-825f-a57f33b25ebc None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.664382 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.665027 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.665312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.665591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.695715 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1382/2781] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:30:28.696874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.709591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7eb12-b606-475c-87bb-bc4886fdf7e6 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.712752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.713409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.713693 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.713969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.714723 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.716338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.720984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.722529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.726521 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1383/2782] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:28.730421 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.731739 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1400/2783] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:30:28.740538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a6dc-a2d2-4164-a268-1bf1b2d01f7b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.745343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.745853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.746138 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.746415 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.747156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.748771 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a951df3-8dfc-4fd9-8f55-39c34aecdb12 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.760202 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1384/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:30:28.764253 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:28.774679 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b8057-70e5-47ee-b8af-4eb07146cb30 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:28.779356 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:28.780261 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.780543 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.780821 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] PATH_INFO: `/v3/projects/039be6f0c149463ab0af4a4c3c1ee645/users/87ad838997354e3d80e226e220d427bf/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.795933 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039be6f0c149463ab0af4a4c3c1ee645, user_id=87ad838997354e3d80e226e220d427bf, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:28.799151 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:28.887105 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1401/2785] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:28 2022] PUT /identity/v3/projects/039be6f0c149463ab0af4a4c3c1ee645/users/87ad838997354e3d80e226e220d427bf/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:28.898465 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:28.898950 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:28.899049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:28.925419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] MFA Rules not processed for user `87ad838997354e3d80e226e220d427bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:28.926658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:28.993328 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1385/2786] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:29.004047 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:29.005988 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:29.083052 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42683-37cc-4ec7-8596-20be70784483 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:29.088755 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c961d005e574c10a93f9a876ac7ce4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:29.089404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:29.089684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:29.089955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:29.098979 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:29.100582 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c81201-a186-4f0b-84f8-5664ee08e952 service nova] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:29.109116 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1402/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:34.481974 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:34.543793 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de87f55-eba7-4194-b9a6-873947118da1 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:34.548317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:34.549170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:34.549454 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:34.549724 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] PATH_INFO: `/v3/users/87ad838997354e3d80e226e220d427bf` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:34.550930 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ad838997354e3d80e226e220d427bf)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:34.552867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:34.753676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ad838997354e3d80e226e220d427bf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:34.754280 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ad838997354e3d80e226e220d427bf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:34.761298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ad838997354e3d80e226e220d427bf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:34.773887 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ad838997354e3d80e226e220d427bf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:34.864088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ad838997354e3d80e226e220d427bf'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:34.870321 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1386/2788] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:34 2022] DELETE /identity/v3/users/87ad838997354e3d80e226e220d427bf => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:34.874889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:34.879005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:34.879005 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:34.894190 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:34.895390 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:34.955070 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1403/2789] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:34.964582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:34.965962 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:35.021324 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76672f-5111-4d56-88af-9ce9acfd1f4d admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:35.024881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:35.025517 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.025797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.026087 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.034820 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:35.036527 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504bd7-4047-4bdb-8c33-89859c1ebb5d service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:35.045679 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1387/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:35.482682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:35.484210 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:35.496205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb04f6-cbbc-4b74-9c7b-dbcff28fe907 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:35.501456 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:35.502315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.502591 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.502859 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] PATH_INFO: `/v3/projects/039be6f0c149463ab0af4a4c3c1ee645` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.504083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039be6f0c149463ab0af4a4c3c1ee645)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:35.505991 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:35.624163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039be6f0c149463ab0af4a4c3c1ee645', 'request_id': 'req-e41f352a-678c-4278-bcbd-8dcf70c94824'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:35.630260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039be6f0c149463ab0af4a4c3c1ee645', 'request_id': 'req-e41f352a-678c-4278-bcbd-8dcf70c94824'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:35.717525 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039be6f0c149463ab0af4a4c3c1ee645', 'request_id': 'req-e41f352a-678c-4278-bcbd-8dcf70c94824'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:35.728578 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] The token cache is being invalidate because project 039be6f0c149463ab0af4a4c3c1ee645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:35.728860 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:35.729478 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e41f352a-678c-4278-bcbd-8dcf70c94824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:35.731131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1404/2791] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:35 2022] DELETE /identity/v3/projects/039be6f0c149463ab0af4a4c3c1ee645 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:35.736424 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.736877 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.736994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.755501 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:35.756694 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:35.812683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1388/2792] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:35.821201 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.821493 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.821772 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.839624 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:35.840805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:35.848623 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1405/2793] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:35.852773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:35.862683 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb384c-af34-4035-b602-42f4d82300eb None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:35.868040 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:35.868691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.868971 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.869243 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.870239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:35.870678 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:35.872294 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:35.887074 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1389/2794] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:30:35.891359 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:35.900419 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff58df-93a8-4f12-adee-bb22267c098b None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:35.905060 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:35.905705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:35.905987 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:35.906263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:35.906947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:35.908911 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.008853 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1406/2795] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:35 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:36.012891 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.023350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07f48-a6cc-4137-a9e6-93207e528ca2 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.082149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.082844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.083194 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.083486 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.084197 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.086134 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.167786 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1390/2796] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:36 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:36.171864 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.183263 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a385d5-f72b-4edc-af20-68beb2b0a7bd admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.188002 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.188759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.189049 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.189316 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.190069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.191724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.204230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1407/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:36.208439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.218821 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17af7-d5c4-40ee-b584-b0f0770b539b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.224459 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.225211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.225504 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.225784 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.226548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.228293 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a926df9-4541-401c-b4cd-dfc708b694bb admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.239290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1391/2798] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:36.243642 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.253530 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105d03-2ac0-47bc-9979-0e006179cc40 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.258163 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.259034 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.259319 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.259639 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] PATH_INFO: `/v3/projects/844ef58d0df241a7ad4c885d15af671c/users/5a9636b0e99940fcb8db95014eafc94f/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.273716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844ef58d0df241a7ad4c885d15af671c, user_id=5a9636b0e99940fcb8db95014eafc94f, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.276393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.360753 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1408/2799] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:36 2022] PUT /identity/v3/projects/844ef58d0df241a7ad4c885d15af671c/users/5a9636b0e99940fcb8db95014eafc94f/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:36.371212 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197305c9-765c-4212-8ce3-562f91829088 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.377230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197305c9-765c-4212-8ce3-562f91829088 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.377230 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197305c9-765c-4212-8ce3-562f91829088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.398651 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-197305c9-765c-4212-8ce3-562f91829088 None None] MFA Rules not processed for user `5a9636b0e99940fcb8db95014eafc94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:36.399901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-197305c9-765c-4212-8ce3-562f91829088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:36.462004 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1392/2800] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:36.466445 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.524408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb42d3-486f-4e5d-a748-4e7e27651405 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.528947 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.529593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.529870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.530141 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.530825 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.533399 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.621730 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1409/2801] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:36.625927 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197305c9-765c-4212-8ce3-562f91829088 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.636464 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197305c9-765c-4212-8ce3-562f91829088 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.691362 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.692048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.692329 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.692601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.693286 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.695247 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.775768 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1393/2802] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:36 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:36.779733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.790406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c7e6-0798-4472-8903-faa6bfd5a619 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.795090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.795779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.796065 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.796374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.797097 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.798688 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.810054 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1410/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:36.814918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.825048 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfd40-02b9-46ce-966b-3909ed99da73 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.830531 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.831402 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.831736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.832010 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] PATH_INFO: `/v3/projects/9e3d19acab0c4fd882281ba42d2710fa/users/73a06c4e125d4c9d9503f5a8cea1a03d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.847963 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d19acab0c4fd882281ba42d2710fa, user_id=73a06c4e125d4c9d9503f5a8cea1a03d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.850605 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:36.926523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1394/2804] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:36 2022] PUT /identity/v3/projects/9e3d19acab0c4fd882281ba42d2710fa/users/73a06c4e125d4c9d9503f5a8cea1a03d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:36.930439 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:36.940868 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346873-88d5-4cb3-b2f4-393437d8bece admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:36.994764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:36.995355 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:36.995670 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:36.995949 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:36.996673 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:36.998258 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f6ee-ed5e-47b7-8f6f-81ff2e2756a1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:37.008274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1411/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:37.012381 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:37.023373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a67f-cdb2-46b8-b2d8-cc8d5a8e181b admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:37.028065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:37.028936 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.029215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.029490 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] PATH_INFO: `/v3/projects/9e3d19acab0c4fd882281ba42d2710fa/users/73a06c4e125d4c9d9503f5a8cea1a03d/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.031450 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d19acab0c4fd882281ba42d2710fa, user_id=73a06c4e125d4c9d9503f5a8cea1a03d, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:37.034110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:37.044276 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1395/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:37 2022] PUT /identity/v3/projects/9e3d19acab0c4fd882281ba42d2710fa/users/73a06c4e125d4c9d9503f5a8cea1a03d/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:37.055766 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.056058 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.056340 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.082653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] MFA Rules not processed for user `73a06c4e125d4c9d9503f5a8cea1a03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:37.083918 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:37.150397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1412/2807] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:37.162082 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:37.163854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:37.220376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c02d-774a-4b12-bb46-abf5d6375712 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:37.224096 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:37.224735 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.226467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.226467 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.237929 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:37.239593 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7420-5cf6-4920-94f0-d6d4d39300c6 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:37.250802 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1396/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:37.314542 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:37.375245 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d328e8-79da-47c8-a20b-b0d09eeba77c None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:37.380574 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:37.381520 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.381873 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.382212 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] PATH_INFO: `/v3/users/5a9636b0e99940fcb8db95014eafc94f` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.383438 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9636b0e99940fcb8db95014eafc94f)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:37.385388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:37.611944 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9636b0e99940fcb8db95014eafc94f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:37.618734 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9636b0e99940fcb8db95014eafc94f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:37.630109 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9636b0e99940fcb8db95014eafc94f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:37.712408 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9636b0e99940fcb8db95014eafc94f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:37.713072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9636b0e99940fcb8db95014eafc94f'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:37.719417 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1413/2809] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:37 2022] DELETE /identity/v3/users/5a9636b0e99940fcb8db95014eafc94f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:37.724566 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.724914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.725203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.742992 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:37.744222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:37.801713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1397/2810] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:37.811393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:37.812819 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:37.868168 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000717-9629-4765-9fd8-ce714b42cfec admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:37.871893 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:37.872556 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:37.872817 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:37.873091 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:37.882012 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:37.883816 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:37.893461 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1414/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:38.279271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:38.280752 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:38.294332 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44885-5d70-4aba-a385-609a6db0c9ae None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:38.302394 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:38.303411 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:38.303728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:38.304088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] PATH_INFO: `/v3/projects/844ef58d0df241a7ad4c885d15af671c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:38.305588 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844ef58d0df241a7ad4c885d15af671c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:38.307742 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:38.428728 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844ef58d0df241a7ad4c885d15af671c', 'request_id': 'req-d6641886-4e12-4b6f-b7bb-26df8db25c29'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.434093 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844ef58d0df241a7ad4c885d15af671c', 'request_id': 'req-d6641886-4e12-4b6f-b7bb-26df8db25c29'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.498215 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844ef58d0df241a7ad4c885d15af671c', 'request_id': 'req-d6641886-4e12-4b6f-b7bb-26df8db25c29'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.512068 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] The token cache is being invalidate because project 844ef58d0df241a7ad4c885d15af671c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:38.512360 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.513145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.514755 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1398/2812] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:38 2022] DELETE /identity/v3/projects/844ef58d0df241a7ad4c885d15af671c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:38.519508 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:38.534110 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58514669-9fc9-4597-8b69-61696dfdc197 service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:38.600724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:38.600724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:38.600724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:38.600724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] PATH_INFO: `/v3/users/73a06c4e125d4c9d9503f5a8cea1a03d` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:38.601179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a06c4e125d4c9d9503f5a8cea1a03d)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:38.601179 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:38.799644 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a06c4e125d4c9d9503f5a8cea1a03d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.806492 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a06c4e125d4c9d9503f5a8cea1a03d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.818810 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a06c4e125d4c9d9503f5a8cea1a03d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.912079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a06c4e125d4c9d9503f5a8cea1a03d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.912710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-cda5a001-848a-4299-be32-1cda47113ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a06c4e125d4c9d9503f5a8cea1a03d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:38.920051 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1415/2813] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:38 2022] DELETE /identity/v3/users/73a06c4e125d4c9d9503f5a8cea1a03d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:39.397842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:39.399461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:39.420489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641886-4e12-4b6f-b7bb-26df8db25c29 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:39.492797 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:39.493719 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:39.494007 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:39.494292 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] PATH_INFO: `/v3/projects/9e3d19acab0c4fd882281ba42d2710fa` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:39.495858 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3d19acab0c4fd882281ba42d2710fa)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:39.497853 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:39.620509 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3d19acab0c4fd882281ba42d2710fa', 'request_id': 'req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:39.626900 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3d19acab0c4fd882281ba42d2710fa', 'request_id': 'req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:39.712596 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3d19acab0c4fd882281ba42d2710fa', 'request_id': 'req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:39.725507 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] The token cache is being invalidate because project 9e3d19acab0c4fd882281ba42d2710fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:39.725874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:39.726618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-4e85f36c-2a4c-4f54-9519-01fe2e0caffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:39.728320 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1399/2814] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:39 2022] DELETE /identity/v3/projects/9e3d19acab0c4fd882281ba42d2710fa => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:39.733315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:39.733800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:39.733898 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:39.753284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:39.754475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:39.815484 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1416/2815] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:39.823228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:39.823552 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:39.823831 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:39.842852 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:39.844063 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:39.852435 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1400/2816] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:39.856779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:39.866695 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7a11-0aaf-47ac-ba70-7f2f4aa556f1 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:39.873158 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:39.873830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:39.874120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:39.874394 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:39.875122 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80257) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:39.875426 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:39.877573 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:39.889277 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1417/2817] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:30:39.894325 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:39.903881 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695fc8a-0108-4394-83c1-486fdb052b06 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:39.909387 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:39.910305 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:39.910594 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:39.910875 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:39.911667 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:39.913561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.054915 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1401/2818] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:39 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:40.056041 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.067172 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042450-7eb0-4c2a-a444-171ae76d7923 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.126106 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.127358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.127682 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.127959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.128662 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.130617 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.213170 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1418/2819] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:40 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:30:40.217429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.228601 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602e3d-f535-468c-898e-96a9c2bfd1cb admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.233495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.234150 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.234429 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.239326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.239326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.239326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.248598 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1402/2820] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:30:40.252996 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.263602 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db82f4-3d39-44a9-ae18-defe78674b0c admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.269250 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.269849 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.270134 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.270435 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.271142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.272828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204379a4-04b2-4f9d-b5b1-bf94f21f5739 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.286430 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1419/2821] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:40.287682 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.298617 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b468f-e378-4c40-b643-eaf728717e66 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.303702 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.304607 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.304885 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.305204 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] PATH_INFO: `/v3/projects/ac5f221b250740848ec63c9858aba0d6/users/9e8496910d1e438496b5b6fde1319e3d/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.321180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5f221b250740848ec63c9858aba0d6, user_id=9e8496910d1e438496b5b6fde1319e3d, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.323948 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.418876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1403/2822] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:40 2022] PUT /identity/v3/projects/ac5f221b250740848ec63c9858aba0d6/users/9e8496910d1e438496b5b6fde1319e3d/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:40.429244 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.429536 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.429844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.457738 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] MFA Rules not processed for user `9e8496910d1e438496b5b6fde1319e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:40.458957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:40.525669 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1420/2823] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:40.530272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.593988 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a587a-da31-45a5-80f6-a5151fa5e02a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.598975 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.599874 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.600162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.600503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.601196 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.603111 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.696889 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1404/2824] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:40 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:40.700983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.712539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc4f8d-436c-4869-b2ce-c7f68977a094 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.768549 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.769208 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.769495 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.769769 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.770468 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.772441 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.885131 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1421/2825] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:40 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:40.886326 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.897770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871bc91-4253-4255-8358-900405686f52 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.902969 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.903894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.904178 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.904455 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.905189 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.906859 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:40.919913 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1405/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:40.924627 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:40.935707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20516-2838-4a1a-b318-b913ba86d817 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:40.941260 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:40.942364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:40.942653 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:40.942938 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] PATH_INFO: `/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc/users/b9cbb9168639422fa65a1a34285a1274/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:40.959424 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a073f91dfd9b4dfb8c3a78e140930edc, user_id=b9cbb9168639422fa65a1a34285a1274, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:40.962094 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:41.053685 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1422/2827] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:40 2022] PUT /identity/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc/users/b9cbb9168639422fa65a1a34285a1274/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:30:41.057873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:41.068966 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3861a1-ed8d-407d-956c-61fa96ef9564 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:41.128224 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:41.128890 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:41.129166 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:41.129451 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:41.130156 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:41.131773 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2bb91-4e39-4f86-b5d6-b0106e4a076e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:41.141422 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1406/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:30:41.145888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:41.156393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afc480-6715-422a-87c2-7be0b7908462 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:41.161428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:41.162312 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:41.162593 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:41.162889 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] PATH_INFO: `/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc/users/b9cbb9168639422fa65a1a34285a1274/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:41.164885 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a073f91dfd9b4dfb8c3a78e140930edc, user_id=b9cbb9168639422fa65a1a34285a1274, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:41.167535 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:41.181794 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1423/2829] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:41 2022] PUT /identity/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc/users/b9cbb9168639422fa65a1a34285a1274/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:41.198283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:41.198577 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:41.198876 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:41.225979 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] MFA Rules not processed for user `b9cbb9168639422fa65a1a34285a1274`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:41.227180 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:41.302941 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1407/2830] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:41.314833 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:41.316539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:41.379156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff491e1-d62d-4a15-9c86-17c7aff233c1 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:41.382831 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:41.383491 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:41.383857 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:41.384133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:41.398327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:41.398327 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:41.404272 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1424/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:41.447844 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:41.449370 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:41.461562 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425127-54fa-4d9d-966c-59ecf6e69201 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:41.465275 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:41.465911 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:41.466190 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:41.466461 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:41.522790 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:41.524272 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a9595-7fec-45fc-9658-4c37e4aed876 service cinder] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:41.533918 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1408/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:46.592717 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:46.656545 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c24cc-aefb-4fe7-9e51-f4fd0f31d0c8 service cinder] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:46.661967 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:46.662869 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:46.663145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:46.663413 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] PATH_INFO: `/v3/users/9e8496910d1e438496b5b6fde1319e3d` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:46.664656 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8496910d1e438496b5b6fde1319e3d)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:46.666563 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:46.816237 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8496910d1e438496b5b6fde1319e3d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:46.822870 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8496910d1e438496b5b6fde1319e3d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:46.835055 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8496910d1e438496b5b6fde1319e3d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:46.888745 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8496910d1e438496b5b6fde1319e3d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:46.889374 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8496910d1e438496b5b6fde1319e3d'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:46.896278 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1425/2833] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:46 2022] DELETE /identity/v3/users/9e8496910d1e438496b5b6fde1319e3d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:46.900947 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:46.901391 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:46.901563 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:46.919860 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:46.921059 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:46.978118 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1409/2834] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:46.987971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:46.989469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:47.045518 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6ca3-752f-4868-a4fe-48717c265f9e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:47.049315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:47.050137 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:47.050427 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:47.050705 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:47.059830 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:47.061249 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:47.071239 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1426/2835] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:47.480445 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:47.482153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:47.496457 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637d4aa-bebf-43de-9de3-6470df975c88 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:47.503466 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:47.509338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:47.509338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:47.509338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] PATH_INFO: `/v3/projects/ac5f221b250740848ec63c9858aba0d6` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:47.509338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5f221b250740848ec63c9858aba0d6)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:47.509338 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:47.622842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5f221b250740848ec63c9858aba0d6', 'request_id': 'req-79949e6c-58ea-4ada-b751-b292c30b2b84'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.628945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5f221b250740848ec63c9858aba0d6', 'request_id': 'req-79949e6c-58ea-4ada-b751-b292c30b2b84'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.688933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5f221b250740848ec63c9858aba0d6', 'request_id': 'req-79949e6c-58ea-4ada-b751-b292c30b2b84'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.700626 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] The token cache is being invalidate because project ac5f221b250740848ec63c9858aba0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:47.700912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.701534 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.703065 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1410/2836] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:47 2022] DELETE /identity/v3/projects/ac5f221b250740848ec63c9858aba0d6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:47.707180 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:47.716664 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c14d-3d42-4a02-87fd-82c0b82bdcfd service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:47.771383 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:47.772291 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:47.772575 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:47.772854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] PATH_INFO: `/v3/users/b9cbb9168639422fa65a1a34285a1274` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:47.774129 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cbb9168639422fa65a1a34285a1274)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:47.776138 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:47.925016 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cbb9168639422fa65a1a34285a1274'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.931658 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cbb9168639422fa65a1a34285a1274'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:47.943840 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cbb9168639422fa65a1a34285a1274'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.009069 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cbb9168639422fa65a1a34285a1274'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.009704 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cbb9168639422fa65a1a34285a1274'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.016120 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1427/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:47 2022] DELETE /identity/v3/users/b9cbb9168639422fa65a1a34285a1274 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:48.397373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.398934 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.415160 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e6c-58ea-4ada-b751-b292c30b2b84 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:48.476609 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:48.477489 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.477770 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.478041 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] PATH_INFO: `/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.479358 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a073f91dfd9b4dfb8c3a78e140930edc)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:48.481347 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:48.489102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.493251 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.507829 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895f16-d415-433f-bae3-e21498241b99 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:48.512862 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:48.513802 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.514088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.514364 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] PATH_INFO: `/v3/users/3adab342a360456793dc320c9f32395c` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.515674 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adab342a360456793dc320c9f32395c)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:48.522888 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:48.587100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a073f91dfd9b4dfb8c3a78e140930edc', 'request_id': 'req-7583a878-dbcb-44fd-9d67-b452868b5da2'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.592503 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a073f91dfd9b4dfb8c3a78e140930edc', 'request_id': 'req-7583a878-dbcb-44fd-9d67-b452868b5da2'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.654919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a073f91dfd9b4dfb8c3a78e140930edc', 'request_id': 'req-7583a878-dbcb-44fd-9d67-b452868b5da2'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.667315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] The token cache is being invalidate because project a073f91dfd9b4dfb8c3a78e140930edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:48.667646 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.668269 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-7583a878-dbcb-44fd-9d67-b452868b5da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.669813 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1411/2838] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:48 2022] DELETE /identity/v3/projects/a073f91dfd9b4dfb8c3a78e140930edc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:48.675299 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64705bf-c496-4f37-a7f7-83ab14147502 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.676162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64705bf-c496-4f37-a7f7-83ab14147502 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.676162 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64705bf-c496-4f37-a7f7-83ab14147502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.694408 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-a64705bf-c496-4f37-a7f7-83ab14147502 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:48.695171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adab342a360456793dc320c9f32395c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.695610 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-a64705bf-c496-4f37-a7f7-83ab14147502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.701986 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adab342a360456793dc320c9f32395c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.714268 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adab342a360456793dc320c9f32395c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.752613 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1412/2839] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:48.760229 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.760520 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.760814 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.769315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adab342a360456793dc320c9f32395c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.769923 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-3426e94e-8f74-4b4c-9bbf-68ad7ebfd54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adab342a360456793dc320c9f32395c'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:48.776121 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1428/2840] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:48 2022] DELETE /identity/v3/users/3adab342a360456793dc320c9f32395c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:48.778764 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:48.780107 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.782892 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.783186 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.783481 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.801333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:48.802521 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.839220 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1413/2841] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:48.843373 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.852094 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ffd85-d131-42ac-b0fc-4969308460dd None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:48.856658 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:48.857296 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.857582 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.857855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.858570 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:48.858879 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:48.860447 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1429/2842] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 08:30:48.860579 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:48.870068 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.871405 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:48.875430 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1414/2843] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 08:30:48.876343 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.886071 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36afd-c9ed-49f9-ab16-ea3d9daa301a admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:48.890917 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:48.891586 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.891866 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.892139 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.893363 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:48.895228 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:48.931333 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d754d-44a6-48ee-9e72-03aa3884c22a None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:48.934935 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:48.935675 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:48.935959 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:48.936259 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:48.945594 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:48.947009 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:48.956759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1430/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 08:30:48.985100 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1415/2845] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:48 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:30:48.989192 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:48.998534 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12883b-949b-4db5-9e99-e6f0658d7efa service neutron] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.055406 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.056102 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.056414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.056713 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.057393 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.059297 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.178377 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1431/2846] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:48 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:49.182309 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.194416 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2796d13-3bd0-46e1-8084-94478121a243 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.205671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.205671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.205671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.205671 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.206924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.206924 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.214214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1416/2847] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:49.218432 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.229079 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b822-994d-4252-98ab-dd730da51432 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.233724 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.234386 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.234666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.235698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.235698 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.237368 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9d8b-b4b9-4bd1-8393-48998d9707ab admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.250452 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1432/2848] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:49.251628 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.261942 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c248-67c1-438e-9200-4d093e45d09c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.266691 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.268126 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.268409 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.268681 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] PATH_INFO: `/v3/projects/b36d6adfa67741b5a6b009f09ad5e852/users/e35760c4a14a46b7ba6412c4bb46037c/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.284108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36d6adfa67741b5a6b009f09ad5e852, user_id=e35760c4a14a46b7ba6412c4bb46037c, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.287009 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.352618 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1417/2849] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:49 2022] PUT /identity/v3/projects/b36d6adfa67741b5a6b009f09ad5e852/users/e35760c4a14a46b7ba6412c4bb46037c/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:30:49.362844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.363133 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.363414 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.382468 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.386385 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:49.391897 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] MFA Rules not processed for user `e35760c4a14a46b7ba6412c4bb46037c`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:49.393875 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:49.450931 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb1088-0b33-4fb5-b934-6a7089273bec admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.456404 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.457249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.457525 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.457791 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] PATH_INFO: `/v3/projects/fabc86b427c04f8984d07cadb14de587` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.458977 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabc86b427c04f8984d07cadb14de587)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.460919 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.461485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1433/2850] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:49.468160 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.478233 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1adfcb-501b-40ff-821b-091f51939502 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.482780 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.483418 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.483726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.484000 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.484678 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.486616 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.556997 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabc86b427c04f8984d07cadb14de587', 'request_id': 'req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:49.562505 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabc86b427c04f8984d07cadb14de587', 'request_id': 'req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:49.568177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1434/2851] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:49 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:49.568964 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.629716 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726069-f492-4f7a-9a2d-fdf9a298e1d5 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.631843 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabc86b427c04f8984d07cadb14de587', 'request_id': 'req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:49.634564 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.640579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.640579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.640579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] PATH_INFO: `/v3/users` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.640579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.640579 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.643894 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] The token cache is being invalidate because project fabc86b427c04f8984d07cadb14de587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:49.644203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:49.644854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:49.646413 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1418/2852] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:49 2022] DELETE /identity/v3/projects/fabc86b427c04f8984d07cadb14de587 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:30:49.741155 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1435/2853] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:49 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 08:30:49.745443 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.746895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:49.816576 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972f7d9-f4a7-4b6b-b7a6-d03c53d81a2c admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.821469 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.822161 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.822439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.822710 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.823433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.825108 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.839025 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1419/2854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:49.840469 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.850867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb2bd-3f5b-4924-90f0-41eb366e1a09 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:49.855618 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:49.856523 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:49.856805 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:49.857083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] PATH_INFO: `/v3/projects/08c8c960c8e94344b34ecc9cc1997db9/users/24625a2bae654e61b87fb4858f2f22b8/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:49.873451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c8c960c8e94344b34ecc9cc1997db9, user_id=24625a2bae654e61b87fb4858f2f22b8, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:49.876145 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:49.946526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1436/2855] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:49 2022] PUT /identity/v3/projects/08c8c960c8e94344b34ecc9cc1997db9/users/24625a2bae654e61b87fb4858f2f22b8/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:49.950599 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:49.960419 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06704d-ef97-4891-aaf5-3c711f3d4e87 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:50.014308 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:50.014967 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.015252 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.015557 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.016271 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:50.017855 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc49f-5d30-4dd3-ad63-23fba2b31f9c admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:50.027241 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1420/2856] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 08:30:50.031284 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:50.041436 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4a1-789d-4056-9905-4ca95a4a8021 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:50.045961 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:50.046828 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.047111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.047388 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] PATH_INFO: `/v3/projects/08c8c960c8e94344b34ecc9cc1997db9/users/24625a2bae654e61b87fb4858f2f22b8/roles/62d99ec236024c42b980e2afdcd9b18a` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.050090 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c8c960c8e94344b34ecc9cc1997db9, user_id=24625a2bae654e61b87fb4858f2f22b8, role_id=62d99ec236024c42b980e2afdcd9b18a)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:50.052733 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:50.062622 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1437/2857] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:50 2022] PUT /identity/v3/projects/08c8c960c8e94344b34ecc9cc1997db9/users/24625a2bae654e61b87fb4858f2f22b8/roles/62d99ec236024c42b980e2afdcd9b18a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:50.077386 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.077675 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.077946 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.103011 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] MFA Rules not processed for user `24625a2bae654e61b87fb4858f2f22b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:50.104239 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:50.170123 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1421/2858] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:50.181292 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:50.182984 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:50.239955 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e8f6d-ab8c-4d20-a418-31489b41e596 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:50.243539 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:50.244177 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.244480 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.244731 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.253547 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:50.254971 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f17b1-23d0-4c21-bd4b-3abca98e5a35 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:50.264088 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1438/2859] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:50.385799 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:50.444746 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85fb9d-e942-4230-9ec9-86c09bda7d8a None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:50.449159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:50.450006 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.450283 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.450555 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] PATH_INFO: `/v3/users/e35760c4a14a46b7ba6412c4bb46037c` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.451740 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35760c4a14a46b7ba6412c4bb46037c)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:50.453630 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:50.613143 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35760c4a14a46b7ba6412c4bb46037c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:50.613713 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35760c4a14a46b7ba6412c4bb46037c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:50.620350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35760c4a14a46b7ba6412c4bb46037c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:50.631870 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35760c4a14a46b7ba6412c4bb46037c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:50.714635 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35760c4a14a46b7ba6412c4bb46037c'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:50.721253 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1422/2860] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:50 2022] DELETE /identity/v3/users/e35760c4a14a46b7ba6412c4bb46037c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:50.725851 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.726136 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.726410 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.743610 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:50.744779 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:50.799666 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1439/2861] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:50.809614 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:50.810994 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:50.865983 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3136e8a-9de5-4b44-80c0-c9562fab0293 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:50.869513 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:50.870149 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:50.870433 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:50.870708 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:50.879492 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:50.880914 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:50.890049 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1423/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:51.323351 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:51.324855 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:51.337205 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71502a-e2eb-4d5d-80bd-263c1ca4528f None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:51.343514 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:51.344404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:51.344701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:51.344974 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] PATH_INFO: `/v3/projects/b36d6adfa67741b5a6b009f09ad5e852` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:51.346784 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36d6adfa67741b5a6b009f09ad5e852)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:51.348800 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:51.439764 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36d6adfa67741b5a6b009f09ad5e852', 'request_id': 'req-c4837b42-c751-4d05-af95-a570c2746134'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.445013 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36d6adfa67741b5a6b009f09ad5e852', 'request_id': 'req-c4837b42-c751-4d05-af95-a570c2746134'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.532475 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36d6adfa67741b5a6b009f09ad5e852', 'request_id': 'req-c4837b42-c751-4d05-af95-a570c2746134'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.544242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] The token cache is being invalidate because project b36d6adfa67741b5a6b009f09ad5e852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:51.544529 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.545156 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.546714 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1440/2863] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:51 2022] DELETE /identity/v3/projects/b36d6adfa67741b5a6b009f09ad5e852 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:51.550709 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:51.560145 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dae36-9502-4e7f-b681-a65e3d927f2e service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:51.619698 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:51.620559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:51.620839 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:51.621110 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] PATH_INFO: `/v3/users/24625a2bae654e61b87fb4858f2f22b8` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:51.622300 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24625a2bae654e61b87fb4858f2f22b8)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:51.624232 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:51.807523 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24625a2bae654e61b87fb4858f2f22b8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.808127 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24625a2bae654e61b87fb4858f2f22b8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.815306 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24625a2bae654e61b87fb4858f2f22b8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.826546 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24625a2bae654e61b87fb4858f2f22b8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.882665 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-b8566004-79b5-49aa-9d00-f5ae6e61543e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24625a2bae654e61b87fb4858f2f22b8'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:51.888538 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1424/2864] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:51 2022] DELETE /identity/v3/users/24625a2bae654e61b87fb4858f2f22b8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:52.288315 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.289841 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:52.303274 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837b42-c751-4d05-af95-a570c2746134 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.359332 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.360152 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.360431 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.360701 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] PATH_INFO: `/v3/projects/08c8c960c8e94344b34ecc9cc1997db9` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.362370 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c8c960c8e94344b34ecc9cc1997db9)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.364287 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.458538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c8c960c8e94344b34ecc9cc1997db9', 'request_id': 'req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:52.463707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c8c960c8e94344b34ecc9cc1997db9', 'request_id': 'req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:52.520404 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c8c960c8e94344b34ecc9cc1997db9', 'request_id': 'req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:52.531318 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] The token cache is being invalidate because project 08c8c960c8e94344b34ecc9cc1997db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:52.533538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:52.533538 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-5e7fcd50-0509-4ef2-b8aa-dc412824c0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:52.534242 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1441/2865] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:52 2022] DELETE /identity/v3/projects/08c8c960c8e94344b34ecc9cc1997db9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:52.539303 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.539632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.539912 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.558298 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:52.559522 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:52.616842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1425/2866] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:52.626420 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.626710 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.626985 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.645230 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:52.646428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:52.654401 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1442/2867] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:52.659170 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.669016 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e6f8-4bc1-420c-bf45-4dbddff70202 None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.674250 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.674901 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.675183 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.675497 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.676227 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80256) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 08:30:52.676536 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.678124 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.689211 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1426/2868] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 12 08:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 08:30:52.693188 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.702083 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df859fa-5dd7-4504-8a8b-7e4bf264feae None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.706707 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.707343 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.707657 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.707932 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.708614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.710485 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.780726 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1443/2869] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 12 08:30:52 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:52.785654 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.795462 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8da6d5-50ce-44d5-9cec-b94cdaa2b386 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.849958 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.850643 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.850928 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.851222 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.851957 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.853897 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.922018 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1427/2870] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 12 08:30:52 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 08:30:52.926781 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.937526 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c441de-1717-4da6-89f8-9c6179e14ac9 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.943770 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.944421 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.944699 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.944973 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.945684 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.947267 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.957358 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1444/2871] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:52.961174 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:52.970745 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79331f1d-62fd-47a3-b210-fd913719e9ea admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:52.975676 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:52.976376 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:52.976659 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:52.976935 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:52.977647 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:52.979273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f1f1-05e9-4a70-a025-fc3b15567cae admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:52.989559 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1428/2872] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 12 08:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 08:30:52.993506 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:53.003786 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f162-d887-438e-b959-59b9c5f03ad8 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:53.008434 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:53.009301 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] REQUEST_METHOD: `PUT` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.009587 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.009867 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] PATH_INFO: `/v3/projects/1099e2180fab42f7a4532bbfd48ad8e0/users/1715914c409d469e880a548fc1ba9157/roles/782e17093ca8451595a9135e239dc30b` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.023752 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1099e2180fab42f7a4532bbfd48ad8e0, user_id=1715914c409d469e880a548fc1ba9157, role_id=782e17093ca8451595a9135e239dc30b)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:53.026363 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:53.097836 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1445/2873] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 12 08:30:52 2022] PUT /identity/v3/projects/1099e2180fab42f7a4532bbfd48ad8e0/users/1715914c409d469e880a548fc1ba9157/roles/782e17093ca8451595a9135e239dc30b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 08:30:53.160602 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] REQUEST_METHOD: `POST` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.161032 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.161322 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.188064 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.auth.core [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] MFA Rules not processed for user `1715914c409d469e880a548fc1ba9157`. Rule list: `[]` (Enabled: `True`). {{(pid=80256) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:53.189315 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:53.253906 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1429/2874] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:53.265428 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:53.267082 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:53.322451 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff916-fee4-4860-9fce-477b6069770e admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:53.326142 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b877e3bebb09444381fdee3fdbe4be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:53.326778 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.327064 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.327345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.335846 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:53.337289 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edcdfc-4c17-45a3-b132-98aee87ebcd9 service cinder] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:53.346783 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1446/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:53.366350 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:53.426121 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950360-c2b1-4b76-b47c-7b3dfb10965f None None] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:53.430706 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:53.431584 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.431873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.432152 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] PATH_INFO: `/v3/users/1715914c409d469e880a548fc1ba9157` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.433604 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1715914c409d469e880a548fc1ba9157)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:53.435532 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:53.619759 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1715914c409d469e880a548fc1ba9157'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:53.620398 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1715914c409d469e880a548fc1ba9157'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:53.627054 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1715914c409d469e880a548fc1ba9157'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:53.638481 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1715914c409d469e880a548fc1ba9157'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:53.703346 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1715914c409d469e880a548fc1ba9157'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:53.709856 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1430/2876] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:30:53 2022] DELETE /identity/v3/users/1715914c409d469e880a548fc1ba9157 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:30:53.714407 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] REQUEST_METHOD: `POST` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.714692 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.714962 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.733459 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.auth.core [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] MFA Rules not processed for user `6096b896d07e4c27995c80c998efa491`. Rule list: `[]` (Enabled: `True`). {{(pid=80257) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 08:30:53.734634 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:53.790487 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1447/2877] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 12 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 08:30:53.800061 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:53.801449 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:53.857583 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177ac07-4911-4323-a955-b679cef887ce admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:53.861290 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:53.861933 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:53.862249 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:53.862528 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:53.873632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:53.873632 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:53.882446 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1431/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:30:54.267489 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:30:54.269561 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:30:54.281169 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc929fe-f188-40e4-99a2-466365a6f179 None None] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:30:54.286127 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:30:54.286983 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:30:54.287266 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:30:54.287567 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] PATH_INFO: `/v3/projects/1099e2180fab42f7a4532bbfd48ad8e0` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:30:54.288742 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1099e2180fab42f7a4532bbfd48ad8e0)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:30:54.290635 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:30:54.391376 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1099e2180fab42f7a4532bbfd48ad8e0', 'request_id': 'req-f1192610-25a1-42ea-96f7-ba684382a908'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:54.396887 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1099e2180fab42f7a4532bbfd48ad8e0', 'request_id': 'req-f1192610-25a1-42ea-96f7-ba684382a908'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:54.454128 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1099e2180fab42f7a4532bbfd48ad8e0', 'request_id': 'req-f1192610-25a1-42ea-96f7-ba684382a908'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:54.464966 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] The token cache is being invalidate because project 1099e2180fab42f7a4532bbfd48ad8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80257) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:30:54.466562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:54.466562 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:30:54.467400 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1448/2879] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:30:54 2022] DELETE /identity/v3/projects/1099e2180fab42f7a4532bbfd48ad8e0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:32:01.371846 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:01.373854 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:01.435867 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d042e1-1d4c-4794-825b-3e67383888fb service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:01.485842 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561d7ef7b45441fb6b39aed78cf7921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:01.486495 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] REQUEST_METHOD: `GET` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:01.486781 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:01.487058 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:01.489117 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:01.591153 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:01.592631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:01.611242 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1432/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 08:32:05.203771 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:05.205323 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:05.263550 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1192610-25a1-42ea-96f7-ba684382a908 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:05.268209 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:05.269078 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:05.269360 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:05.269648 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] PATH_INFO: `/v3/users/e67b9ceb63634f56a5467f71e93372bf` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:05.270842 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67b9ceb63634f56a5467f71e93372bf)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:05.272796 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:05.437504 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67b9ceb63634f56a5467f71e93372bf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.444072 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67b9ceb63634f56a5467f71e93372bf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.455854 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67b9ceb63634f56a5467f71e93372bf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.527345 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67b9ceb63634f56a5467f71e93372bf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.527926 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67b9ceb63634f56a5467f71e93372bf'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.533915 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1449/2881] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:32:05 2022] DELETE /identity/v3/users/e67b9ceb63634f56a5467f71e93372bf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:32:05.784439 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:05.796159 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181df8-1db0-4c0f-8b22-1c79ca54e164 service neutron] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:05.852701 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:05.853548 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:05.853827 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:05.854098 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] PATH_INFO: `/v3/projects/0f60295b03664d50a09fad14e734f40a` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:05.855273 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f60295b03664d50a09fad14e734f40a)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:05.857214 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:05.965798 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f60295b03664d50a09fad14e734f40a', 'request_id': 'req-ba85302a-2760-44a5-83d9-21ace81c21d3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:05.971039 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f60295b03664d50a09fad14e734f40a', 'request_id': 'req-ba85302a-2760-44a5-83d9-21ace81c21d3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.035892 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f60295b03664d50a09fad14e734f40a', 'request_id': 'req-ba85302a-2760-44a5-83d9-21ace81c21d3'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.046949 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] The token cache is being invalidate because project 0f60295b03664d50a09fad14e734f40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:32:06.047233 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.047864 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.049473 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1433/2882] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:32:05 2022] DELETE /identity/v3/projects/0f60295b03664d50a09fad14e734f40a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:32:06.053511 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:06.055515 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:06.068347 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d82ed-110e-4189-b435-22265fc38116 admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:06.123221 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:06.124111 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:06.124397 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:06.124672 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] PATH_INFO: `/v3/users/9a267407f62d4fbc91719b7e7832e679` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:06.125848 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a267407f62d4fbc91719b7e7832e679)` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:06.127792 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:06.280357 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a267407f62d4fbc91719b7e7832e679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.287219 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a267407f62d4fbc91719b7e7832e679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.298844 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a267407f62d4fbc91719b7e7832e679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.359321 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a267407f62d4fbc91719b7e7832e679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.359957 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.notifications [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a267407f62d4fbc91719b7e7832e679'} {{(pid=80257) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.365843 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1450/2883] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 12 08:32:06 2022] DELETE /identity/v3/users/9a267407f62d4fbc91719b7e7832e679 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:32:06.636203 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Authenticating user token {{(pid=80256) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:06.637631 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.fernet_utils [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80256) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:06.652245 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85302a-2760-44a5-83d9-21ace81c21d3 admin admin] Validating token access rules against request {{(pid=80256) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:06.708736 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6096b896d07e4c27995c80c998efa491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70f2e3c61bc141f3b38a097da3fa11ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80256) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:06.709591 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:06.709873 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:06.710148 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] PATH_INFO: `/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5` {{(pid=80256) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:06.711317 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf1d1c302b84afe9b2c4c576f54c3d5)` {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:06.713248 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] RBAC: Authorization granted {{(pid=80256) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:06.823088 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf1d1c302b84afe9b2c4c576f54c3d5', 'request_id': 'req-a490ccff-2045-443e-b42c-d2a982356889'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.828561 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf1d1c302b84afe9b2c4c576f54c3d5', 'request_id': 'req-a490ccff-2045-443e-b42c-d2a982356889'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.907945 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf1d1c302b84afe9b2c4c576f54c3d5', 'request_id': 'req-a490ccff-2045-443e-b42c-d2a982356889'} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.919938 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] The token cache is being invalidate because project 7cf1d1c302b84afe9b2c4c576f54c3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80256) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 08:32:06.920304 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.920895 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: DEBUG keystone.notifications [None req-a490ccff-2045-443e-b42c-d2a982356889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80256) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 08:32:06.922452 dv-cinder-836944-3-iscsi devstack@keystone.service[80256]: [pid: 80256|app: 0|req: 1434/2884] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 12 08:32:06 2022] DELETE /identity/v3/projects/7cf1d1c302b84afe9b2c4c576f54c3d5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 08:32:43.653619 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Authenticating user token {{(pid=80257) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 08:32:43.655115 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:43.741171 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fdc48-0fa2-4cd0-982d-681bf563c2aa admin admin] Validating token access rules against request {{(pid=80257) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 08:32:43.797625 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3c0373ebde41b9aac512bf44553b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77adf95580be4bdc84d9332712e64813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80257) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 08:32:43.798269 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] REQUEST_METHOD: `GET` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 08:32:43.798554 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 08:32:43.798827 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80257) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 08:32:43.800614 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.fernet_utils [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80257) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 08:32:43.811759 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 08:32:43.813454 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965de8-5b17-412f-8241-9de02f9512c2 service placement] RBAC: Authorization granted {{(pid=80257) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 08:32:43.828787 dv-cinder-836944-3-iscsi devstack@keystone.service[80257]: [pid: 80257|app: 0|req: 1451/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 12 08:32:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)